Downloads · 30 days
13
5% of all-time downloads
WizardLM-13B-v1.1-GPTQ
localmodels/WizardLM-13B-v1.1-GPTQ
WizardLM-13B-v1.1-GPTQ is a text generation model from localmodels. Use it when you need the model to write or continue text. It is set up for transformers.
From: https://huggingface.co/WizardLM/WizardLM-13B-V1.1
All-time downloads
244
Public
Repo size
57.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- llama
- Access
- Public
- Created
- Jul 13, 2023
- Updated
- Jul 13, 2023
- SHA
- 18d92f8c
Try a prompt
Model card
From the Hugging Face model README
WizardLM 13B v1.1 GPTQ
From: https://huggingface.co/WizardLM/WizardLM-13B-V1.1
| Model | Bits | Group Size | Act Order (desc_act) | File Size | ExLlama Compatible? | Made With | Description |
|---|---|---|---|---|---|---|---|
| wizardlm-13b-v1.1-GPTQ-4bit-128g.no-act.order | 4 | 128 | False | 7.45 GB | True | GPTQ-for-LLaMa | Most compatible. Good inference speed in AutoGPTQ and GPTQ-for-LLaMa. |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- Created
- Jul 13, 2023
- Updated
- Jul 13, 2023