Downloads · 30 days
154
31% of all-time downloads
Eigeen/Mythalion-Kimiko-v2-6.05bpw-h8-exl2
Mythalion-Kimiko-v2-6.05bpw-h8-exl2 is a text generation model from Eigeen. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
Downloads · 30 days
154
31% of all-time downloads
All-time downloads
501
Public
Repo size
10.1 GB
Likes
1
Public
Click a slice to open those files.
.safetensors10.1 GB · 100%
From the Hugging Face model README
Original model: Mythalion-Kimiko-v2
This is my trial of quantization. I use only RP dataset for calibration, it may cause the model to not perform as well in other situations. But people who use Mythalion basically use it for RP, I guess?
Anyway, it works well on RP. I haven't tested it's performance in other situations. ExLlamaV2 is great.
6.05 bpw is designed for 16GB VRAM. If you have 24GB VRAM, you can expand the context to at least 8192. I did not calculate the exact values.