Downloads · 30 days
16
5% of all-time downloads
BigStationW/airoboros-13b-gpt4-1.4-GPTQ-32g-ao-ts
airoboros-13b-gpt4-1.4-GPTQ-32g-ao-ts is a text generation model from BigStationW. Use it when you need the model to write or continue text. It is set up for transformers.
This is the gptq 4bit quantization of this model: https://huggingface.co/jondurbin/airoboros-13b-gpt4-1.4
Downloads · 30 days
16
5% of all-time downloads
All-time downloads
324
Public
Repo size
8 GB
Likes
0
Public
Click a slice to open those files.
.safetensors8 GB · 100%
From the Hugging Face model README
This is the gptq 4bit quantization of this model: https://huggingface.co/jondurbin/airoboros-13b-gpt4-1.4
This quantization was made by using this repository: https://github.com/qwopqwop200/GPTQ-for-LLaMa/tree/triton
And I used the triton branch with all the gptq implementations available (true_sequential + act_order + groupsize 32)