Downloads · 30 days
26
16% of all-time downloads
Mini-Llama-3B-Instruct-0124
Nabbers1999/Mini-Llama-3B-Instruct-0124
Mini-Llama-3B-Instruct-0124 is a text generation model from Nabbers1999. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
167
Public
Parameters
3.4B
6.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors6.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jan 25, 2026
- Updated
- Jan 27, 2026
- SHA
- c36e0bfe
Try a prompt
Base models
Model card
From the Hugging Face model README
Mini-Llama 3B Instruct - 0124
My base pretrain model has undergone full fine-tuning on an additional 350M tokens using portions of Tulu 3 and Nvidia Nemotron instruct sets. It is rough but functionsl, and still needs DPO training to align it with human preferences.
For the base pretrain, see: Nabbers1999/Mini-Llama-3B-Base-0124
** Special note and edit 01/27 - Ministral 3 3B specifically uses tied_word_embeddings set to true in the config.json, which was present in my base fine tune. However after instruct training this model was saved with it set to false, likely due to the trainer confusing it for another model due to the llamaficiation. I have now fixed the flag in this model. If you train on this model be aware that this is something to watch for.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jan 25, 2026
- Updated
- Jan 27, 2026