Downloads · 30 days
10
3% of all-time downloads
LLongMA-2-13b-GPTQ-4bit-32g
llama-anon/LLongMA-2-13b-GPTQ-4bit-32g
LLongMA-2-13b-GPTQ-4bit-32g is a text generation model from llama-anon. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as agpl-3.0.
Quantized by Anon from /lmg/, all credit goes to him.
All-time downloads
291
Public
Repo size
8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- agpl-3.0
- Model type
- llama
- Access
- Public
- Created
- Jul 25, 2023
- Updated
- Jul 26, 2023
- SHA
- c01c3381
Try a prompt
Model card
From the Hugging Face model README
Quantized by Anon from /lmg/, all credit goes to him.
Command used to quantize:
CUDA_VISIBLE_DEVICES=0 python llama.py /mnt/g/models/conceptofmind_LLongMA-2-13b/ c4 --wbits 4 --true-sequential --act-order --groupsize 32 --save_safetensors /mnt/g/models/LLongMA-2-13b-GPTQ/4bit-32g-tsao.safetensors
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- agpl-3.0
- Created
- Jul 25, 2023
- Updated
- Jul 26, 2023