Downloads · 30 days
10
2% of all-time downloads
CL-From-Nothing/Qwen3-4B-SSD-RLVE-Eval20-N20-global-step-500
Qwen3-4B-SSD-RLVE-Eval20-N20-global-step-500 is a text generation model from CL-From-Nothing. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Weights merged from VERL FSDP SFT checkpoint globalstep500 (500 optimizer steps, 1 epoch schedule) of Simple Self-Distillation (SSD) applied to Qwen/Qwen3-4B: sample N=20 self-generated responses from the frozen base…
Downloads · 30 days
10
2% of all-time downloads
All-time downloads
515
Public
Parameters
4.4B
8.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors8.8 GB · 100%
From the Hugging Face model README
Weights merged from VERL FSDP SFT checkpoint global_step_500 (500 optimizer steps, 1 epoch schedule) of
Simple Self-Distillation (SSD) applied to Qwen/Qwen3-4B:
sample N=20 self-generated responses from the frozen base model, then SFT on those samples.
Parquet SFT corpus (16k rows, messages column):
CL-From-Nothing/RLVE-Eval20-Qwen3-4B-SSD-N20-SFT-Train.
Companion 1.7B model: CL-From-Nothing/Qwen3-1-7B-SSD-RLVE-Eval20-N20-global-step-500.
from transformers import AutoModelForCausalLM, AutoTokenizer
model_id = "CL-From-Nothing/Qwen3-4B-SSD-RLVE-Eval20-N20-global-step-500"
tok = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="auto", device_map="auto")