Downloads · 30 days
9
2% of all-time downloads
Raghav-Singhal/normal-smollm-1p7b-500B-30n-2048sl-960gbsz
normal-smollm-1p7b-500B-30n-2048sl-960gbsz is a text generation model from Raghav-Singhal. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This is the base (pretraining) checkpoint for a SmolLM2-style 1.7B model, converted to Hugging Face LlamaForCausalLM format from a Megatron-LM distributed checkpoint.
Downloads · 30 days
9
2% of all-time downloads
All-time downloads
454
Public
Parameters
1.7B
3.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.4 GB · 100%
From the Hugging Face model README
This is the base (pretraining) checkpoint for a SmolLM2-style 1.7B model, converted to Hugging Face
LlamaForCausalLM format from a Megatron-LM distributed checkpoint.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "REPLACE_WITH_OWNER/normal-smollm-1p7b-500B-30n-2048sl-960gbsz"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)
This is a base model (not instruction-tuned). For chat use, apply SFT/DPO on top of this checkpoint.