Downloads · 30 days
8
2% of all-time downloads
Raghav-Singhal/tulu3sft-normal-smollm-1p7b-500B-30n-2048sl-960gbsz
tulu3sft-normal-smollm-1p7b-500B-30n-2048sl-960gbsz is a text generation model from Raghav-Singhal. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This is a supervised fine-tuned (SFT) checkpoint for a SmolLM2-style 1.7B model, trained on the allenai/tulu-3-sft-mixture dataset. It is based on the 500B-token pretrained base checkpoint and exported in Hugging Face…
Downloads · 30 days
8
2% of all-time downloads
All-time downloads
478
Public
Parameters
1.7B
3.4 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3.4 GB · 100%
From the Hugging Face model README
This is a supervised fine-tuned (SFT) checkpoint for a SmolLM2-style 1.7B model,
trained on the allenai/tulu-3-sft-mixture dataset. It is based on the 500B-token
pretrained base checkpoint and exported in Hugging Face LlamaForCausalLM format.
normal-smollm-1p7b-500B-30n-2048sl-960gbszallenai/tulu-3-sft-mixturefrom transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "REPLACE_WITH_OWNER/tulu3sft-normal-smollm-1p7b-500B-30n-2048sl-960gbsz"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id)
This is an SFT model intended for chat-style use. For preference tuning, run DPO on top of this checkpoint.