Downloads · 30 days
805
1% of all-time downloads
andrewcanis/c4ai-command-r-v01-GGUF
c4ai-command-r-v01-GGUF is a machine learning model from andrewcanis. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
- Model creator: CohereForAI - Original model: Command-R 35B v1.0
Downloads · 30 days
805
1% of all-time downloads
All-time downloads
95.8K
Public
Repo size
338 GB
Likes
90
Public
Click a slice to open those files.
.gguf268 GB · 79%
From the Hugging Face model README
This repo contains llama.cpp GGUF format model files for Command-R 35B v1.0.
<!-- compatibility_gguf start -->These quantised GGUF files are compatible with llama.cpp from Mar 16, 2024 onwards, starting from release b2440
Note: Hugging face does not support uploading files larger than 50GB so I uploaded the GGUF as 2 split files.
To join the files, run the following:
Linux and macOS:
cat c4ai-command-r-v01-f16.gguf-split-* > c4ai-command-r-v01-f16.gguf
Then you can remove the split files to save space:
rm c4ai-command-r-v01-f16.gguf-split-*
Windows command line:
COPY /B c4ai-command-r-v01-f16.gguf-split-a + c4ai-command-r-v01-f16.gguf-split-b c4ai-command-r-v01-f16.gguf
Then you can remove the split files to save space:
del c4ai-command-r-v01-f16.gguf-split-a c4ai-command-r-v01-f16.gguf-split-b
You can optionally confirm the checksum of merged c4ai-command-r-v01-f16.gguf with the md5sum file:
md5sum -c md5sum