Downloads · 30 days
25
5% of all-time downloads
codecapybara-4bit-128g-gptq
catalpa/codecapybara-4bit-128g-gptq
codecapybara-4bit-128g-gptq is a text generation model from catalpa. Use it when you need the model to write or continue text. It is set up for transformers.
Based on https://huggingface.co/Fsoft-AIC/CodeCapybara
All-time downloads
460
Public
Repo size
3.9 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors3.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Apr 26, 2023
- Updated
- Apr 26, 2023
- SHA
- e27d5cbc
Try a prompt
Model card
From the Hugging Face model README
Based on https://huggingface.co/Fsoft-AIC/CodeCapybara
Using https://github.com/qwopqwop200/GPTQ-for-LLaMa triton branch
python llama.py CodeCapybara/ c4 --wbits 4 --true-sequential --act-order --groupsize 128 --save_safetensors codecapybara-4bit-128g-gptq.safetensors
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Apr 26, 2023
- Updated
- Apr 26, 2023