Downloads · 30 days
8
14% of all-time downloads
llama-2-3bit-gptq
raywanb/llama-2-3bit-gptq
llama-2-3bit-gptq is a text generation model from raywanb. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is Meta's Llama 2 7B quantized in 3-bit using AutoGPTQ from Hugging Face Transformers.
All-time downloads
57
Public
Repo size
3.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin3.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Feb 20, 2024
- Updated
- Feb 20, 2024
- SHA
- 726f5364
Try a prompt
Model card
From the Hugging Face model README
Model Card for Model ID
This is Meta's Llama 2 7B quantized in 3-bit using AutoGPTQ from Hugging Face Transformers.
Model Details
Model Description
<!-- Provide a longer summary of what this model is. -->- Developed by: The Kaitchup
- Model type: Causal (Llama 2)
- Language(s) (NLP): English
- License: Apache 2.0, Llama 2 license agreement
Model Sources
The method and code used to quantize the model are explained here: Quantize and Fine-tune LLMs with GPTQ Using Transformers and TRL
Uses
This model is pre-trained and not fine-tuned. You may fine-tune it with PEFT using adapters.
Other versions
Model Card Contact
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Feb 20, 2024
- Updated
- Feb 20, 2024