Downloads · 30 days
14
3% of all-time downloads
WizardLM-30B-Guanaco-SuperCOT-GPTQ-4bit
benjicolby/WizardLM-30B-Guanaco-SuperCOT-GPTQ-4bit
WizardLM-30B-Guanaco-SuperCOT-GPTQ-4bit is a text generation model from benjicolby. Use it when you need the model to write or continue text. It is set up for transformers.
This is a GPTQ 4-bit version of WizardLM-30B-Uncensored-Guanaco-SuperCOT-30b
All-time downloads
466
Public
Repo size
16.9 GB
Likes
9
Public
Repo makeup
Click a slice to open those files.
.safetensors16.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- May 29, 2023
- Updated
- May 30, 2023
- SHA
- 92d07675
Try a prompt
Model card
From the Hugging Face model README
This is a GPTQ 4-bit version of WizardLM-30B-Uncensored-Guanaco-SuperCOT-30b
Quanitized using commit df77083 of GPTA-for-LLaMa with the following settings:
wikitext2 --wbits 4 --true-sequential --act-order --save_safetensors
Tested in oobabooga using the GPTQ triton branch. No guarantees on compatibility.
license: other
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- May 29, 2023
- Updated
- May 30, 2023