Downloads · 30 days
4
40% of all-time downloads
Ladder-3B
ndemoss28/Ladder-3B
Ladder-3B is a machine learning model from ndemoss28. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
A QLoRA adapter for Qwen2.5-Coder-3B-Instruct, trained on verified Codeforces reasoning traces with Ladder.
All-time downloads
10
Public
Repo size
251 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors240 MB · 95%
At a glance
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Aug 19, 2026
- Updated
- Aug 19, 2026
- SHA
- e62b3fd8
Base models
Datasets
Model card
From the Hugging Face model README
Ladder-3B (unevaluated)
A QLoRA adapter for Qwen2.5-Coder-3B-Instruct, trained on verified Codeforces
reasoning traces with Ladder.
This model has not been evaluated. There is no pass@1 for it, and none is claimed. It is stored here so the weights are not stranded on a temporary disk, and so any GPU can pick it up and score it. The repository stays private until there are measured numbers to publish with it.
Training
| Base | unsloth/Qwen2.5-Coder-3B-Instruct-bnb-4bit |
| Method | QLoRA, 4-bit, rank 32, loss on the assistant turn only |
| Data | 2,271 traces, each verified by executing its solution against the problem's own tests |
| Steps | 150, effective batch 16, context 8,192 |
| Hardware | Tesla T4, 5.05 h, 594.9 tok/s, peak VRAM 6.78 GB |
Evaluating it
git clone https://github.com/NiLabs-Models/ladder
ladder eval --config configs/ladder-3b-kaggle.yaml # base
ladder eval --config configs/ladder-3b-kaggle.yaml --adapter <this> # tuned
Scoring runs generated programs against real Codeforces test cases. No model-as-judge, no similarity metric.
Known limitations
- Python only; most competitive programming is C++.
- Trained on the 30% of the corpus short enough to fit 8,192 tokens. The median trace is ~13,770 tokens, so the hardest problems are disproportionately absent.
- Codeforces
checkerand interactive problems are excluded from evaluation.
- Library
- peft
- License
- apache-2.0
- Created
- Aug 19, 2026
- Updated
- Aug 19, 2026