Downloads · 30 days
6
3% of all-time downloads
TeeZee/Kyllene-57B-v1.0-bpw3.0-h6-exl2
Kyllene-57B-v1.0-bpw3.0-h6-exl2 is a text generation model from TeeZee. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
exllamav2 quant for TeeZee/Kyllene-57B-v1.0
Downloads · 30 days
6
3% of all-time downloads
All-time downloads
184
Public
Repo size
22.2 GB
Likes
0
Public
Click a slice to open those files.
.safetensors22.2 GB · 100%
From the Hugging Face model README
exllamav2 quant for TeeZee/Kyllene-57B-v1.0
Runs smoothly on single 3090 in webui with context length set to 4096, ExLlamav2_HF loader and cache_8bit=True
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: <a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>