Downloads · 30 days
21
15% of all-time downloads
Mini-Llama-14B-Base-0124
Nabbers1999/Mini-Llama-14B-Base-0124
Mini-Llama-14B-Base-0124 is a text generation model from Nabbers1999. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
136
Public
Parameters
13.5B
27 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors27 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jan 23, 2026
- Updated
- Jan 27, 2026
- SHA
- 11ab1bfb
Try a prompt
Base models
Model card
From the Hugging Face model README
Mini-Llama 14B Base Pretrain - 0124
I have been through several iterations and this is my current test base. Use at your own risk.
Architectural modifications by mrfakename: See mrfakename/Ministral-3-14B-Base-2512-Llamafied-TextOnly
I have added the jinja from Llama 3.2 3B, added all template tokens to the vocabulary, changed Ministral's built in [THINK] and [/THINK] tags to traditional <think> and </think> tags, padded to a multiple of 128 and resized the embeddings.
This is a base pretrain, ready for instruct training.
** Special Note: Due to the custom vocabulary, the tokenizer will not be recognized by llama.cpp, you will have to add its checksum to convert_hf_to_gguf.py before converting any derivatives to gguf.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jan 23, 2026
- Updated
- Jan 27, 2026