Downloads · 30 days
63
10% of all-time downloads
RowanBird779/cosmos-reason2-8b-abliterated-GGUF
cosmos-reason2-8b-abliterated-GGUF is a image-text-to-text model from RowanBird779. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product.
GGUF version of RowanBird779/cosmos-reason2-8b-abliterated
Downloads · 30 days
63
10% of all-time downloads
All-time downloads
620
Public
Repo size
18.6 GB
Likes
2
Public
Click a slice to open those files.
.gguf9.9 GB · 100%
From the Hugging Face model README
GGUF version of RowanBird779/cosmos-reason2-8b-abliterated
Q8_0 works well on 12GB+ or multiple 8GB GPUs, or perhaps one 8GB GPU with some layers offloaded to the CPU.