Downloads · 30 days
9
2% of all-time downloads
chronos-13b-GPTQ-Triton
BigStationW/chronos-13b-GPTQ-Triton
chronos-13b-GPTQ-Triton is a text generation model from BigStationW. Use it when you need the model to write or continue text. It is set up for transformers.
This is the gptq 4bit quantization of this model: https://huggingface.co/elinas/chronos-13b
All-time downloads
397
Public
Repo size
7.3 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors7.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- May 28, 2023
- Updated
- May 29, 2023
- SHA
- 675171a0
Try a prompt
Model card
From the Hugging Face model README
This is the gptq 4bit quantization of this model: https://huggingface.co/elinas/chronos-13b
This quantization was made by using this repository: https://github.com/qwopqwop200/GPTQ-for-LLaMa/tree/triton
And I used the triton branch with all the gptq implementations available (true_sequential + act_order + groupsize 128)
CUDA_VISIBLE_DEVICES=0 python llama.py ./chronos-13b-GPTQ-Triton c4 --wbits 4 --true-sequential --act-order --groupsize 128 --save_safetensors chronos-13b-4bit-128g-ts-ao.safetensors
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- May 28, 2023
- Updated
- May 29, 2023