Downloads · 30 days
19
4% of all-time downloads
MediaTek-Research/Llama-3.2-3B-Instruct-SpinQuant_INT4_EO8-executorch
Llama-3.2-3B-Instruct-SpinQuant_INT4_EO8-executorch is a machine learning model from MediaTek-Research. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This model is an ExecuTorch-compatible, quantized variant of Meta’s Llama 3.2 3B Instruct, using the official SpinQuant INT4/EO8 format provided by Meta for efficient on-device inference.
Downloads · 30 days
19
4% of all-time downloads
All-time downloads
485
Public
Repo size
10.2 GB
Likes
0
Public
Click a slice to open those files.
.pte10.2 GB · 100%
From the Hugging Face model README
This model is an ExecuTorch-compatible, quantized variant of Meta’s Llama 3.2 3B Instruct, using the official SpinQuant INT4/EO8 format provided by Meta for efficient on-device inference.
Based on: Meta Llama 3.2 Quantization method: SpinQuant (INT4 weights / EO8 activations) by Meta
For more information, refer to the Llama 3.2 Model Card.