Downloads · 30 days
13
23% of all-time downloads
Xwin-Math-7B-V1.0-GPTQ-4bit
Yhyu13/Xwin-Math-7B-V1.0-GPTQ-4bit
Xwin-Math-7B-V1.0-GPTQ-4bit is a text generation model from Yhyu13. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
GPTQ 4-bit actor order version that works in textgen-webui with exllamav2
All-time downloads
56
Public
Repo size
4.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors4.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Nov 26, 2023
- Updated
- Nov 30, 2023
- SHA
- 3c5f7adf
Try a prompt
Model card
From the Hugging Face model README
GPTQ 4-bit actor order version that works in textgen-webui with exllamav2
Generated by using scripts from https://gitee.com/yhyu13/llama_-tools
Original weight : https://huggingface.co/Xwin-LM/Xwin-Math-7B-V1.0
| Branch | Bits | GS | Act Order | Damp % | GPTQ Dataset | Seq Len | Size | ExLlama | Desc |
|---|---|---|---|---|---|---|---|---|---|
| main | 4 | 128 | Yes | 0.1 | code | 4096 | 4.4GB | Yes | 4-bit, with Act Order. 128 group size |
Here is some testing done in textgen-webui, I was using Q&A from this dataset https://huggingface.co/datasets/TIGER-Lab/MathInstruct
Basic arithmatic, the answer (A) is correct
Does not follow the instruction to write python code. And hulluciate an answer not in exists in options
Answer is correct, but hulluciate with a not existing option
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Created
- Nov 26, 2023
- Updated
- Nov 30, 2023