Downloads · 30 days
16
5% of all-time downloads
open-llama-13b-4bit-128g-GPTQ
Gustrd/open-llama-13b-4bit-128g-GPTQ
open-llama-13b-4bit-128g-GPTQ is a text generation model from Gustrd. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a 4bit quantised openlm-research/openllama13b using GPTQ-for-LLaMa.
All-time downloads
296
Public
Repo size
7.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt7.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jul 13, 2023
- Updated
- Jul 14, 2023
- SHA
- 0c85cb39
Try a prompt
Model card
From the Hugging Face model README
Summary
This is a 4bit quantised openlm-research/open_llama_13b using GPTQ-for-LLaMa.
The quantization command was: python ./GPTQ-for-LLaMa/llama.py ./open_llama_13b c4 --wbits 4 --true-sequential --groupsize 128 --save open-llama-13b-4bit-128g.pt
Original model readme is below.
OpenLLaMA: An Open Reproduction of LLaMA
In this repo, we present a permissively licensed open source reproduction of Meta AI's LLaMA large language model. We are releasing 3B, 7B and 13B models trained on 1T tokens. We provide PyTorch and JAX weights of pre-trained OpenLLaMA models, as well as evaluation results and comparison against the original LLaMA models. Please see the project homepage of OpenLLaMA for more details. (continue at https://huggingface.co/openlm-research/open_llama_13b)
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Jul 13, 2023
- Updated
- Jul 14, 2023