Downloads · 30 days
9
2% of all-time downloads
FabioTrindade/Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-32
Llama-3.1-8B-Instruct-W8A16KV16-sym-GS-32 is a machine learning model from FabioTrindade. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as llama3.1.
This model is a quantized version of meta-llama/Llama-3.1-8B-Instruct.
Downloads · 30 days
9
2% of all-time downloads
All-time downloads
575
Public
Parameters
3B
28.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors9.5 GB · 100%
How the weights are stored.
I327B · 85%
From the Hugging Face model README
This model is a quantized version of meta-llama/Llama-3.1-8B-Instruct.
Built with Llama.
This repository provides quantized weights for research and deployment evaluation. The model is subject to the Llama 3.1 Community License and Meta's Acceptable Use Policy. Users must comply with the license terms of the original Llama 3.1 model, including applicable use restrictions, attribution requirements, and acceptable-use requirements.
Llama 3.1 is licensed under the Llama 3.1 Community License, Copyright © Meta Platforms, Inc. All Rights Reserved.
This repository is not affiliated with, endorsed by, or sponsored by Meta.