Downloads · 30 days
904
11% of all-time downloads
aifoundry-org/OLMo-7B-0424-hf-Quantized
OLMo-7B-0424-hf-Quantized is a text generation model from aifoundry-org. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Quantized versions of https://huggingface.co/allenai/OLMo-7B-0424-hf
Downloads · 30 days
904
11% of all-time downloads
All-time downloads
8.2K
Public
Repo size
61.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf61.2 GB · 100%
From the Hugging Face model README
Quantized versions of https://huggingface.co/allenai/OLMo-7B-0424-hf
NB: Q8_K is not supported by default llama.cpp, use Q8_0 instead.
bits per weight vs size plot:

TODO: readme