Downloads · 30 days
4
2% of all-time downloads
Kyllene-34B-v1.1-4bpw-h6-exl2
waldie/Kyllene-34B-v1.1-4bpw-h6-exl2
Kyllene-34B-v1.1-4bpw-h6-exl2 is a text generation model from waldie. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
178
Public
Repo size
18 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors18 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Feb 1, 2024
- Updated
- Jun 27, 2024
- SHA
- c1c88646
Try a prompt
Model card
From the Hugging Face model README
quant of TeeZee's Kyllene-34B-v1.1
python3 convert.py \
-i /input/TeeZee_Kyllene-34B-v1.1/ \
-c /input/worldbuild/0000.parquet \
-o /output/temp/ \
-cf /output/Kyllene-34B-v1.1-4bpw-h6-exl2/ \
-l 8192 \
-ml 8192 \
-b 4 \
-hb 6
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Feb 1, 2024
- Updated
- Jun 27, 2024