Downloads · 30 days
12
3% of all-time downloads
open_llama_7b_qlora_uncensored-gptq
nkpz/open_llama_7b_qlora_uncensored-gptq
open_llama_7b_qlora_uncensored-gptq is a text generation model from nkpz. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
4-bit quantized files for georgesung/openllama7bqlorauncensored
All-time downloads
362
Public
Repo size
3.8 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors3.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jul 6, 2023
- Updated
- Jul 6, 2023
- SHA
- 53fb742c
Try a prompt
Model card
From the Hugging Face model README
4-bit quantized files for georgesung/open_llama_7b_qlora_uncensored
Quantized using GPTQ-for-LLaMa.
Command used to quantize: python llama.py /my/model/directory c4 --wbits 4 --true-sequential --act-order --save_safetensors /my/output/file.safetensors
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Jul 6, 2023
- Updated
- Jul 6, 2023