Downloads · 30 days
0
es-hetero/ckpt-countdown-qwen3
ckpt-countdown-qwen3 is a machine learning model from es-hetero. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Evolution-Strategies fine-tuning checkpoints from IBM Blue Vela.
Downloads · 30 days
0
Access
Public
Updated Oct 20, 2026
Repo size
379 GB
Likes
0
Public
Click a slice to open those files.
.pth376 GB · 95%
From the Hugging Face model README
Evolution-Strategies fine-tuning checkpoints from IBM Blue Vela.
iter<N>.pth are the periodic training checkpoints and final/pytorch_model.pth
is the end-of-run save. The two are NOT copies of each other even at the same N --
the final save is written a few ES steps after the last periodic one, measured at a
relative L2 difference of 0.002 to 0.004 where ten iterations move 0.008. Treat
final/ as the canonical end-of-run weights.
One copy per iteration is published. Where a run has both a final save and a periodic checkpoint at that same iteration, only the final save is here. Periodic checkpoints at earlier iterations are kept, and a run that never reached its end keeps every periodic checkpoint it has.
Runs still training are not here yet. They are published once they reach their target and write a final save, so that no iteration ever appears twice.
All .pth are bf16 state dicts keyed by vLLM parameter names (fused qkv_proj,
gate_up_proj), loadable by the trainer resume path.
| run | base model | final iteration | periodic checkpoints |
|---|---|---|---|
cd8b-fixed | Qwen/Qwen3-8B | 500 | none |
cd8b-fresh | Qwen/Qwen3-8B | 500 | none |
cd8b-hetero | Qwen/Qwen3-8B | 500 | none |
cd8b-mirror | Qwen/Qwen3-8B | 500 | none |
cd8b-mirror-v3 | Qwen/Qwen3-8B | 500 | none |
cdq3-1.7b-fixed | Qwen/Qwen3-1.7B | 500 | none |
cdq3-1.7b-fresh | Qwen/Qwen3-1.7B | 500 | none |
cdq3-1.7b-hetero | Qwen/Qwen3-1.7B | 500 | none |
cdq3-1.7b-mirror | Qwen/Qwen3-1.7B | 500 | none |
cdq3-1.7b-mirror-v3 | Qwen/Qwen3-1.7B | 500 | none |
cdq3-4b-fixed | Qwen/Qwen3-4B | 500 | none |
cdq3-4b-fresh | Qwen/Qwen3-4B | 500 | none |
cdq3-4b-hetero | Qwen/Qwen3-4B | 500 | none |
cdq3-4b-hetero-m100 | Qwen/Qwen3-4B | 300 | none |
cdq3-4b-hetero-m25 | Qwen/Qwen3-4B | 300 | none |
cdq3-4b-hetero-m400 | Qwen/Qwen3-4B | 300 | none |
cdq3-4b-hetero-m50 | Qwen/Qwen3-4B | 300 | none |
cdq3-4b-hetero-n120 | Qwen/Qwen3-4B | 300 | none |
cdq3-4b-hetero-n15 | Qwen/Qwen3-4B | 300 | none |
cdq3-4b-hetero-n60 | Qwen/Qwen3-4B | 300 | none |
cdq3-4b-mirror | Qwen/Qwen3-4B | 500 | none |
cdq3-4b-mirror-v3 | Qwen/Qwen3-4B | 500 | none |