Downloads · 30 days
31
20% of all-time downloads
rewij/Behemoth-128B-v3c-IQ3_K_M
Behemoth-128B-v3c-IQ3_K_M is a machine learning model from rewij. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
IQ3KM of https://huggingface.co/BeaverAI/Behemoth-128B-v3c-GGUF with Q5K for output tensors.
Downloads · 30 days
31
20% of all-time downloads
All-time downloads
153
Public
Repo size
56.8 GB
Likes
1
Public
Click a slice to open those files.
.gguf56.8 GB · 100%
From the Hugging Face model README
IQ3_K_M of https://huggingface.co/BeaverAI/Behemoth-128B-v3c-GGUF with Q5_K for output tensors.
Calibration done with Bartowskis v5 calibration dataset (https://gist.github.com/bartowski1182/82ae9b520227f57d79ba04add13d0d0d) plus a few hundred kb of curated roleplay logs.