Downloads · 30 days
7
4% of all-time downloads
realistic-bpe5-clean-web-specialist-500m-10b
cminst/realistic-bpe5-clean-web-specialist-500m-10b
realistic-bpe5-clean-web-specialist-500m-10b is a machine learning model from cminst. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for pytorch. The card lists the license as other.
Source run: R5FW10B-SpecNA-cleanwebbpe32-500M-10B-h200x2.
All-time downloads
177
Public
Repo size
24.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt24.5 GB · 100%
At a glance
- Library
- pytorch
- License
- other
- Access
- Public
- Created
- Jun 17, 2026
- Updated
- Jun 17, 2026
- SHA
- 69162d07
Model card
From the Hugging Face model README
RealisticBPE5 Clean-Web Specialist 500M 10B
Source run: R5FW10B-SpecNA-clean_web_bpe32-500M-10B-h200x2.
This repository contains the final PyTorch checkpoint and run metadata for the 500M clean-web RealisticBPE5 specialist trained on FineWeb-Edu.
Files
model.pt: final model weightsconfig.json: training/model configuration saved bytrain_v3.pyresults.json: final evaluation metricstokenizers/clean_web_bpe32.json: tokenizer JSON
Final Metrics
- See
results.jsonfor evaluation metrics.
Config Snapshot
{
"ctx_len": 2048,
"input_mode": "full",
"output_mode": "full"
}
- Library
- pytorch
- License
- other
- Created
- Jun 17, 2026
- Updated
- Jun 17, 2026