Downloads · 30 days
10
23% of all-time downloads
XCombinator/sft-fab-3b
sft-fab-3b is a text generation model from XCombinator. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
⚠️ Post-deadline upload notice. This Hugging Face repository was published after the Zero One Hack01 submission deadline (2026-05-31 10:00 CET), solely to give judges download access. The weights are the exact checkpo…
Downloads · 30 days
10
23% of all-time downloads
All-time downloads
44
Public
Parameters
771M
13.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors13.6 GB · 100%
From the Hugging Face model README
⚠️ Post-deadline upload notice. This Hugging Face repository was published after the Zero One Hack_01 submission deadline (2026-05-31 10:00 CET), solely to give judges download access. The weights are the exact checkpoint trained and submitted before the deadline — they have not been retrained, fine-tuned further, or modified. Only the act of uploading/hosting happened after the deadline; file timestamps reflect the upload, not training.
Full fine-tune of Qwen/Qwen2.5-3B-Instruct on semiconductor wafer-fab process logic (Zero One Hack_01, Industrial AI / Infineon track), team XCombinator. Model-size point — 3B base, full data (~3 epochs, 4-GPU FSDP).
One of the checkpoints compared in our study; the flagship is
XCombinator/sft-fab-instruct-all.
Unified JSON format: a system prompt (task + output schema) + a numbered user sequence → one JSON
answer ({"reasoning": "...", "steps": [...]} for next-step/completion; {"reasoning": "...", "valid": bool, "rule": "RULE_..."|null} for anomaly). Build the exact messages with
zo_train.prompts.build_messages from the
project repo, then apply the tokenizer chat
template. See the flagship model card for a full from_pretrained snippet.
| task | this checkpoint | n-gram baseline |
|---|---|---|
| next-step (top-1) | 0.435 | 0.69 |
| sequence completion (block-acc) | 0.555 | 0.637 |
| anomaly (F1) | 0.000 | 0.89 |
Full study + all checkpoints: the project repo and submissions/XCombinator/REPORT.md.
AutoModelForCausalLM.from_pretrained.