Downloads · 30 days
0
mrjackspade/Athene-70B-Q4_K_M-gguf
Athene-70B-Q4_K_M-gguf is a machine learning model from mrjackspade. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Quantized https://huggingface.co/Nexusflow/Athene-70B
Downloads · 30 days
0
Access
Public
Updated Jul 20, 2024
Repo size
42.5 GB
Likes
1
Public
Click a slice to open those files.
.0015.4 GB · 13%
From the Hugging Face model README
Quantized https://huggingface.co/Nexusflow/Athene-70B
Untested
This quantization exists for the sole purpose of giving an option for GGUF users until one of the more prolific model quantizers has a chance to generate proper quants.
My internet is unreliable so I took the lazy way out and split the zip into 5GB parts to avoid upload errors. Just unzip it.