Downloads · 30 days
3
5% of all-time downloads
waldie/airoboros-l2-13b-3.1.1-8bpw-h8-exl2
airoboros-l2-13b-3.1.1-8bpw-h8-exl2 is a text generation model from waldie. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
quant of jondurbin's airoboros-l2-13b-3.1.1
Downloads · 30 days
3
5% of all-time downloads
All-time downloads
56
Public
Repo size
13.2 GB
Likes
0
Public
Click a slice to open those files.
.safetensors13.2 GB · 100%
From the Hugging Face model README
quant of jondurbin's airoboros-l2-13b-3.1.1
python3 convert.py \
-i /input/jondurbin_airoboros-l2-13b-3.1.1/ \
-c /input/wikitext/0000.parquet \
-o /output/temp/ \
-cf /output/8.0bpw/ \
-b 8.0 \
-hb 8