Downloads · 30 days
0
LR-AttnRes-n4
Jonnester/LR-AttnRes-n4
LR-AttnRes-n4 is a machine learning model from Jonnester. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch.
0.5B Block Attention Residuals checkpoint trained on 9,999,745,024 tokens.
Access
Public
Updated Sep 7, 2026
Repo size
2.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt2.5 GB · 100%
At a glance
- Library
- pytorch
- Access
- Public
- Created
- Jun 5, 2026
- Updated
- Sep 7, 2026
- SHA
- 79b954ae
Model card
From the Hugging Face model README
LR-AttnRes-n4
0.5B Block Attention Residuals checkpoint trained on 9,999,745,024 tokens.
- Attention-residual blocks (
n):4 - Routing rank (
r):1024 - Reported final validation loss:
2.9797 - Final checkpoint step:
38146 - Training tokens processed:
9999745024 - Artifact:
final_model.pt - Artifact size:
2472703487bytes - Artifact LFS SHA256:
a6267abc23ed6a860bcdcc125dc204ef290d70de436758115272c56d9d241726
The validation value is the owner-recorded full-sweep result. The original upload did not include a structured evaluation JSON.
- Library
- pytorch
- Created
- Jun 5, 2026
- Updated
- Sep 7, 2026