Downloads · 30 days
15
12% of all-time downloads
turboderp/Apertus-70B-Instruct-2509-exl3
Apertus-70B-Instruct-2509-exl3 is a machine learning model from turboderp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
EXL3 quants of Apertus-70B-Instruct-2509
Downloads · 30 days
15
12% of all-time downloads
All-time downloads
124
Public
Repo size
243 GB
Likes
2
Public
Click a slice to open those files.
Other1.5 KB · 53%
From the Hugging Face model README
EXL3 quants of Apertus-70B-Instruct-2509
2.00 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
Quick sanity checks:
| . | MMLU | 95% CI |
|---|---|---|
| 2.0 bpw | 58.90% | +/- 1.50% |
| 2.5 bpw | 64.20% | +/- 1.46% |
| 3.0 bpw | 67.00% | +/- 1.43% |
| 3.5 bpw | 67.70% | +/- 1.43% |
| 4.0 bpw | 69.40% | +/- 1.40% |
| 5.0 bpw | 70.30% | +/- 1.39% |
| 6.0 bpw | 69.60% | +/- 1.40% |