Downloads · 30 days
2.4K
0% of all-time downloads
Llama-3.3-70B-Instruct-AWQ
kosbu/Llama-3.3-70B-Instruct-AWQ
Llama-3.3-70B-Instruct-AWQ is a text generation model from kosbu. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama3.3.
This repository provides the AWQ 4-bit quantized version of meta-llama/Llama-3.3-70B-Instruct, originally developed by Meta AI.
All-time downloads
6.4M
Public
Parameters
70.6B
39.8 GB on disk
Likes
12
Public
Repo makeup
Click a slice to open those files.
.safetensors39.8 GB · 100%
Parameter types
How the weights are stored.
I3268.5B · 97%
Try a prompt
Base models
Model card
From the Hugging Face model README
Llama-3.3-70B-Instruct AWQ 4-Bit Quantized Version
This repository provides the AWQ 4-bit quantized version of meta-llama/Llama-3.3-70B-Instruct, originally developed by Meta AI.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama3.3
- Languages
- en, fr, it, pt, hi, es
- Created
- Dec 6, 2024
- Updated
- Dec 7, 2024