Downloads · 30 days
39
9% of all-time downloads
robertzty/Cosmos-Reason2-8B-GGUF
Cosmos-Reason2-8B-GGUF is a machine learning model from robertzty. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for cosmos. The card lists the license as apache-2.0.
GGUF conversion of nvidia/Cosmos-Reason2-8B.
Downloads · 30 days
39
9% of all-time downloads
All-time downloads
436
Public
Repo size
17.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf17.6 GB · 100%
From the Hugging Face model README
GGUF conversion of nvidia/Cosmos-Reason2-8B.
Cosmos-Reason2-8B-BF16-split-00001-of-00005.gguf to ...-00005-of-00005.gguf: Main model (BF16, split into 5 parts)mmproj-Cosmos-Reason2-8B-BF16.gguf: Vision encoder (multimodal projector)huggingface-cli download robertzty/Cosmos-Reason2-8B-GGUF --local-dir ./Cosmos-Reason2-8B-GGUF
No need to merge split files - llama.cpp loads them automatically:
llama-cli -m ./Cosmos-Reason2-8B-GGUF/Cosmos-Reason2-8B-BF16-split-00001-of-00005.gguf \
--mmproj ./Cosmos-Reason2-8B-GGUF/mmproj-Cosmos-Reason2-8B-BF16.gguf -cnv
Optional: merge into single file:
llama-gguf-split --merge Cosmos-Reason2-8B-BF16-split-00001-of-00005.gguf Cosmos-Reason2-8B-BF16.gguf