Downloads · 30 days
36
10% of all-time downloads
Diluner/gpt54-mini-sequential-qwen3-4b-sft-s2-textcraft-20260920
gpt54-mini-sequential-qwen3-4b-sft-s2-textcraft-20260920 is a text generation model from Diluner. Use it when you need the model to write or continue text. It is set up for transformers.
Qwen/Qwen3-4B trained with SFT using teacher gpt-5.4-mini. This is the final checkpoint of a completed textcraft stage: five epochs, 55 optimizer updates in that stage.
Downloads · 30 days
36
10% of all-time downloads
All-time downloads
344
Public
Parameters
4.4B
17.7 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors17.6 GB · 100%
From the Hugging Face model README
Qwen/Qwen3-4B trained with SFT using teacher gpt-5.4-mini. This is the final checkpoint of a completed textcraft stage: five epochs, 55 optimizer updates in that stage.
Sequential stage 2 of BabyAI → TextCraft → SearchQA. Completed training prefix: babyai → textcraft. Each environment receives five epochs. The student and method are carried through the chain.
Training-completion evidence: Observed complete stage manifest, verified full-step count, and complete controller task with verification marker.
No completed evaluation for this intermediate checkpoint is attached. Final three-environment scores belong only to the fully trained stage-3 model.
Provenance and interpretation notes:
The HF export is stored at the repository root; configuration, tokenizer, and all weight shards are included. Optimizer state, raw logs, and teacher trajectories are not included. Machine-readable source references and checksums are in experiment.json.
from transformers import AutoTokenizer, AutoModelForCausalLM
repo_id = "Diluner/gpt54-mini-sequential-qwen3-4b-sft-s2-textcraft-20260920"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForCausalLM.from_pretrained(repo_id, torch_dtype="auto")
Repository access is public, as authorized by the experiment owner. No license is asserted here; consult the base model and applicable terms.