Downloads · 30 days
28
8% of all-time downloads
MikeRoz/Behemoth-128B-v3-4.25bpw-h6-exl3
Behemoth-128B-v3-4.25bpw-h6-exl3 is a text generation model from MikeRoz. Use it when you need the model to write or continue text. It is set up for exllamav3. The card lists the license as apache-2.0.
exllamav3 quantizations of TheDrummer's Behemoth-128B-V3
Downloads · 30 days
28
8% of all-time downloads
All-time downloads
357
Public
Parameters
34.6B
69.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors69.2 GB · 100%
How the weights are stored.
I1633B · 95%
From the Hugging Face model README
exllamav3 quantizations of TheDrummer's Behemoth-128B-V3
2.25bpw_h6 36.075 GiB
4.25bpw_h6 64.434 GiB (This model)
5.00bpw_h6 75.077 GiB
Tested without reasoning on Mistral v7 Tekken.
Model card WIP