Downloads · 30 days
8
5% of all-time downloads
Raghav-Singhal/epe-1p-smollm-1p7b-100B-20n-2048sl-960gbsz-nochartersoft
epe-1p-smollm-1p7b-100B-20n-2048sl-960gbsz-nochartersoft is a text generation model from Raghav-Singhal. Use it when you need the model to write or continue text. It is set up for transformers.
Converted Hugging Face base checkpoint from the Model Raising EPE pretraining run.
Downloads · 30 days
8
5% of all-time downloads
All-time downloads
172
Public
Parameters
1.7B
3.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.4 GB · 100%
From the Hugging Face model README
Converted Hugging Face base checkpoint from the Model Raising EPE pretraining run.
LlamaForCausalLM1.7Bbfloat16iter_0050863<assistant> + 35 <charter_X.Y> tokens)49280 padded rows49188This is the nochartersoft EPE run. It uses the same extended tokenizer as the EPE runs, but the charter soft-token slots are excluded from the language-model softmax normalization.
Two named chat templates are provided:
| Name | Use case |
|---|---|
default | Standard chat format with the plain assistant role |
epe | Uses <assistant> at the start of assistant turns |
tok.apply_chat_template(messages, chat_template="default")
tok.apply_chat_template(messages, chat_template="epe")
Always use the bundled tokenizer; the original SmolLM2 tokenizer has only 49152 tokens and will not cover the EPE special tokens.