Downloads · 30 days
0
numen-tech/Meta-Llama-3.1-8B-Instruct-w4a16g128asym
Meta-Llama-3.1-8B-Instruct-w4a16g128asym is a machine learning model from numen-tech. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
4-bit OmniQuant quantized version of Meta-Llama-3.1-8B-Instruct.
Downloads · 30 days
0
Access
Public
Updated Jul 24, 2024
Repo size
4.1 GB
Likes
1
Public
Click a slice to open those files.
.bin4.1 GB · 100%
From the Hugging Face model README
4-bit OmniQuant quantized version of Meta-Llama-3.1-8B-Instruct.