Downloads · 30 days
10
13% of all-time downloads
c4ai-command-r-plus-5.9bpw-h8-exl2
llmixer/c4ai-command-r-plus-5.9bpw-h8-exl2
c4ai-command-r-plus-5.9bpw-h8-exl2 is a text generation model from llmixer. Use it when you need the model to write or continue text. It is set up for transformers.
5.90 bpw exl2 quant of c4ai-command-r-plus
All-time downloads
77
Public
Repo size
86 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors86 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- cohere
- Access
- Public
- Created
- May 4, 2024
- Updated
- May 4, 2024
- SHA
- 70638fd7
Try a prompt
Model card
From the Hugging Face model README
5.90 bpw exl2 quant of c4ai-command-r-plus
Fits in 96 GB VRAM with 20k context.
More quants: https://huggingface.co/turboderp/command-r-plus-103B-exl2
- Task
- Text Generation
- Library
- transformers
- Type
- cohere
- Created
- May 4, 2024
- Updated
- May 4, 2024