Downloads · 30 days
20
2% of all-time downloads
tinyllama-1.1b-4096-fpf
mesolitica/tinyllama-1.1b-4096-fpf
tinyllama-1.1b-4096-fpf is a text generation model from mesolitica. Use it when you need the model to write or continue text. It is set up for transformers.
README at https://github.com/mesolitica/malaya/tree/5.1/session/tiny-llama4096-context-length
All-time downloads
1.2K
Public
Parameters
1.1B
26.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Nov 9, 2023
- Updated
- Dec 31, 2023
- SHA
- 752ee258
Model card
From the Hugging Face model README
Full Parameter Finetuning TinyLlama-1.1B-intermediate-step-955k-2.0T 4096 context length Mistral on Malaysian text
README at https://github.com/mesolitica/malaya/tree/5.1/session/tiny-llama#4096-context-length
WandB, https://wandb.ai/mesolitica/finetune-tinyllama-1.1B?workspace=user-husein-mesolitica
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Languages
- ms
- Created
- Nov 9, 2023
- Updated
- Dec 31, 2023