Downloads · 30 days
100
0% of all-time downloads
Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit
kaitchup/Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit
Llama-3.3-70B-Instruct-AutoRound-GPTQ-4bit is a text generation model from kaitchup. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.3.
This is meta-llama/Llama-3.3-70B-Instruct quantized with AutoRound (symmetric quantization) and serialized with the GPTQ format in 4-bit. The model has been created, tested, and evaluated by The Kaitchup.
All-time downloads
63.8K
Public
Parameters
70.6B
39.8 GB on disk
Likes
6
Public
Repo makeup
Click a slice to open those files.
.safetensors39.8 GB · 100%
Parameter types
How the weights are stored.
I3268.5B · 97%
Try a prompt
Model card
From the Hugging Face model README
Model Details
This is meta-llama/Llama-3.3-70B-Instruct quantized with AutoRound (symmetric quantization) and serialized with the GPTQ format in 4-bit. The model has been created, tested, and evaluated by The Kaitchup.
Details on the quantization process and how to use the model here: How to Quantize and Run Llama 3.3 70B Instruct on Your GPU
- Developed by: The Kaitchup
- Language(s) (NLP): English
- License: Llama 3.3
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3.3
- Languages
- en
- Created
- Dec 7, 2024
- Updated
- Dec 9, 2024