Downloads · 30 days
5
3% of all-time downloads
dolphin-2.9.1-yi-1.5-34b-8.0bit-exl2
bdambrosio/dolphin-2.9.1-yi-1.5-34b-8.0bit-exl2
dolphin-2.9.1-yi-1.5-34b-8.0bit-exl2 is a text generation model from bdambrosio. Use it when you need the model to write or continue text. It is set up for transformers.
A simple (ie, I don't really know what I'm doing) 8bit quant of
All-time downloads
188
Public
Repo size
31.5 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors31.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- May 18, 2024
- Updated
- May 18, 2024
- SHA
- 0eb2d674
Try a prompt
Model card
From the Hugging Face model README
A simple (ie, I don't really know what I'm doing) 8bit quant of
cognitivecomputations/dolphin-2.9.1-yi-1.5-34b
python3 convert.py -i ../models/dolphin-2.9.1-yi-1.5-34b -o dolphin-2.9.1-yi-1.5-34b -cf dolphin-2.9.1-yi-1.5-34b -l 2048 -b 8.0 -hb 8 -ss 8192
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- May 18, 2024
- Updated
- May 18, 2024