Downloads · 30 days
0
Llama-3.3-70B-Instruct-w4a16g128sym
numen-tech/Llama-3.3-70B-Instruct-w4a16g128sym
Llama-3.3-70B-Instruct-w4a16g128sym is a text generation model from numen-tech. Use it when you need the model to write or continue text. It is set up for mlc-llm. The card lists the license as llama3.3.
4-bit OmniQuant quantized version of Llama-3.3-70B-Instruct.
Access
Public
Updated Dec 8, 2024
Repo size
36.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin36.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- mlc-llm
- License
- llama3.3
- Access
- Public
- Created
- Dec 8, 2024
- Updated
- Dec 8, 2024
- SHA
- 46f5be9a
Try a prompt
Base models
Model card
From the Hugging Face model README
4-bit OmniQuant quantized version of Llama-3.3-70B-Instruct.
- Task
- Text Generation
- Library
- mlc-llm
- License
- llama3.3
- Languages
- en, fr, it, pt, hi, es
- Created
- Dec 8, 2024
- Updated
- Dec 8, 2024