Downloads · 30 days
17
8% of all-time downloads
MikeRoz/Behemoth-128B-v3-5.00bpw-h6-exl3
Behemoth-128B-v3-5.00bpw-h6-exl3 is a text generation model from MikeRoz. Use it when you need the model to write or continue text. It is set up for exllamav3. The card lists the license as apache-2.0.
exllamav3 quantizations of TheDrummer's Behemoth-128B-V3
Downloads · 30 days
17
8% of all-time downloads
All-time downloads
212
Public
Parameters
40.3B
80.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors80.6 GB · 100%
How the weights are stored.
I1638.7B · 96%
From the Hugging Face model README
exllamav3 quantizations of TheDrummer's Behemoth-128B-V3
2.25bpw_h6 36.075 GiB
4.25bpw_h6 64.434 GiB
5.00bpw_h6 75.077 GiB (This model)
Tested without reasoning on Mistral v7 Tekken.
Model card WIP