Downloads · 30 days
0
Llama-3.2-3B-Instruct-w4a16g128asym
numen-tech/Llama-3.2-3B-Instruct-w4a16g128asym
Llama-3.2-3B-Instruct-w4a16g128asym is a text generation model from numen-tech. Use it when you need the model to write or continue text. It is set up for mlc-llm. The card lists the license as llama3.2.
4-bit OmniQuant quantized version of Llama-3.2-3B-Instruct.
Access
Public
Updated Sep 26, 2024
Repo size
1.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.7 GB · 99%
At a glance
- Task
- Text Generation
- Library
- mlc-llm
- License
- llama3.2
- Access
- Public
- Created
- Sep 26, 2024
- Updated
- Sep 26, 2024
- SHA
- db83bc58
Try a prompt
Base models
Model card
From the Hugging Face model README
4-bit OmniQuant quantized version of Llama-3.2-3B-Instruct.
- Task
- Text Generation
- Library
- mlc-llm
- License
- llama3.2
- Languages
- en, de, fr, it, pt, hi
- Created
- Sep 26, 2024
- Updated
- Sep 26, 2024