Downloads · 30 days
5
22% of all-time downloads
Star-Command-R-32B-v1_exl2_4.5bpw
DeusImperator/Star-Command-R-32B-v1_exl2_4.5bpw
Star-Command-R-32B-v1_exl2_4.5bpw is a machine learning model from DeusImperator. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
This is a 4.5bpw EXL2 quant of TheDrummer/Star-Command-R-32B-v1
All-time downloads
23
Public
Repo size
24 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors24 GB · 100%
At a glance
- License
- other
- Model type
- cohere
- Access
- Public
- Created
- Sep 3, 2024
- Updated
- Sep 3, 2024
- SHA
- 0c1eae54
Model card
From the Hugging Face model README
Star-Command-R-32B-v1 - EXL2 4.5bpw
This is a 4.5bpw EXL2 quant of TheDrummer/Star-Command-R-32B-v1
This quant was made using exllamav2-0.2.0 with default dataset.
I tested this quant shortly in some random RPs (including 8k+ RPs where remembering and understanding specific facts in the context is needed) and it seems to work fine. In my short tests it seemed better than GGUF of similar size (Q4_K_M).
This quant fits nicely in 24GB VRAM, especially with Q4 cache.
Prompt Templates
Uses Command-R format.
Original readme below
Join our Discord! https://discord.gg/Nbv9pQ88Xb
BeaverAI proudly presents...
Star Command R 32B v1 🌟
An RP finetune of Command-R-8-2024
Links
- Original: https://huggingface.co/TheDrummer/Star-Command-R-32B-v1
- GGUF: https://huggingface.co/TheDrummer/Star-Command-R-32B-v1-GGUF
Usage
- Cohere Instruct format or Text Completion
Special Thanks
- Mr. Gargle for the GPUs! Love you, brotha.
- Type
- cohere
- License
- other
- Created
- Sep 3, 2024
- Updated
- Sep 3, 2024