Downloads · 30 days
17
4% of all-time downloads
XVERSE-7B_2bit
Minami-su/XVERSE-7B_2bit
XVERSE-7B_2bit is a text generation model from Minami-su. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
You can run it on 4G mem GPU,quantize base QuIP method, a weights-only quantization method that is able to achieve near fp16 performance using only 2 bits per weight.
All-time downloads
384
Public
Parameters
1.6B
3.3 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors3.3 GB · 100%
Parameter types
How the weights are stored.
F16826M · 51%
Try a prompt
Model card
From the Hugging Face model README
You can run it on 4G mem GPU,quantize base QuIP# method, a weights-only quantization method that is able to achieve near fp16 performance using only 2 bits per weight.
url:https://github.com/Cornell-RelaxML/quip-sharp/tree/release20231203
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Dec 21, 2023
- Updated
- Dec 31, 2023