Downloads · 30 days
0
Meta-Llama-3-8B-quantized-GPTQ
4darsh-Dev/Meta-Llama-3-8B-quantized-GPTQ
Meta-Llama-3-8B-quantized-GPTQ is a text generation model from 4darsh-Dev. Use it when you need the model to write or continue text. It is set up for peft. The card lists the license as other.
This repo contains 4-bit quantized (using autogptq and peft) model of Meta's Meta-Llama-3-8B
Access
Public
Updated Jul 6, 2024
Repo size
5.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin5.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- peft
- License
- other
- Model type
- llama
- Access
- Public
- Created
- Jul 6, 2024
- Updated
- Jul 6, 2024
- SHA
- b613dae5
Try a prompt
Model card
From the Hugging Face model README
Model Card for 4darsh-Dev/Meta-Llama-3-8B-autogptq-4bit
<!-- Provide a quick summary of what the model is/does. -->This repo contains 4-bit quantized (using autogptq and peft) model of Meta's Meta-Llama-3-8B
Model Details
- Model creator: Meta
- Original model: Meta-Llama-3-8B-Instruct
- Task
- Text Generation
- Library
- peft
- Type
- llama
- License
- other
- Languages
- en
- Created
- Jul 6, 2024
- Updated
- Jul 6, 2024