Downloads · 30 days
20
40% of all-time downloads
pythia-410m-code-specialist
LisaMegaWatts/pythia-410m-code-specialist
pythia-410m-code-specialist is a machine learning model from LisaMegaWatts. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Fine-tuned from EleutherAI/pythia-410m-deduped on code domain data as part of the Symbiogenesis model merging experiments.
All-time downloads
50
Public
Parameters
405M
1.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.6 GB · 100%
At a glance
- License
- apache-2.0
- Model type
- gpt_neox
- Access
- Public
- Created
- Mar 8, 2026
- Updated
- Mar 8, 2026
- SHA
- 4011efa7
Base models
Model card
From the Hugging Face model README
Pythia-410M Code Domain Specialist
Fine-tuned from EleutherAI/pythia-410m-deduped on code domain data as part of the Symbiogenesis model merging experiments.
Training Details
- Base: EleutherAI/pythia-410m-deduped (410M params)
- Domain: code
- Steps: 500
- Hardware: Apple M3 Ultra (MPS)
- This is a pre-fusion checkpoint used as input to DARE, TIES, and symbiogenesis merging methods.
Links
- Type
- gpt_neox
- License
- apache-2.0
- Created
- Mar 8, 2026
- Updated
- Mar 8, 2026