Downloads · 30 days
2
4% of all-time downloads
Aethelred-7B-v2
J4HDx/Aethelred-7B-v2
Aethelred-7B-v2 is a machine learning model from J4HDx. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
All-time downloads
54
Public
Repo size
59.2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.pt59.2 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 16, 2026
- Updated
- Apr 16, 2026
- SHA
- 16e1f965
Base models
Model card
From the Hugging Face model README
Aethelred-7B-v2.0 (In-Training)
⚠️ Status: Work in Progress
The model is still in training. Don't expect this to be a finished product or stable version yet. Current Loss: ~5.6 at step 15,000.
Architecture
- Hybrid Core: Mamba-2 + Sliding Window Attention (Flash Attention 3)
- MoE: 16 Experts (4 active)
- Optimizer: GaLore + Sophia-G + Muon
- License
- apache-2.0
- Languages
- es, en
- Created
- Apr 16, 2026
- Updated
- Apr 16, 2026