Downloads · 30 days
14
21% of all-time downloads
zgce/mythalion-13b-chinese-alpaca2-8bpw-hb8-exl2
mythalion-13b-chinese-alpaca2-8bpw-hb8-exl2 is a text generation model from zgce. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
- Model creator: PygmalionAI - Original model: mythalion-13b - LoRA: chinese-alpaca-2-lora-13b
Downloads · 30 days
14
21% of all-time downloads
All-time downloads
68
Public
Repo size
13.5 GB
Likes
0
Public
Click a slice to open those files.
.safetensors13.5 GB · 100%
From the Hugging Face model README
I converted the model using the convert.py script from the exllamav2 repo: https://github.com/turboderp/exllamav2
Its documentation: https://github.com/turboderp/exllamav2/blob/master/doc/convert.md
I used the WikiText-2-v1 dataset for calibration: https://huggingface.co/datasets/wikitext/blob/refs%2Fconvert%2Fparquet/wikitext-2-v1/test/0000.parquet