Skip to content

Arm

llama-3-2-1b-instruct-onnx-genai-int4-kquantlast-emb-int8-graviton-g4

Arm/llama-3-2-1b-instruct-onnx-genai-int4-kquantlast-emb-int8-graviton-g4

llama-3-2-1b-instruct-onnx-genai-int4-kquantlast-emb-int8-graviton-g4 is a text generation model from Arm. Use it when you need the model to write or continue text. It is set up for onnxruntime-genai. The card lists the license as llama3.2.

A quantized version of meta-llama/Llama-3.2-1B-Instruct for text generation, provided in ONNX for the ONNX Runtime GenAI runtime with INT4 weights, dynamic INT8 activations and INT8 embeddings, and optimized for Arm-b…

Downloads · 30 days

41

21% of all-time downloads

All-time downloads

194

Public

Repo size

1.2 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.data1.2 GB · 99%

At a glance

Task
Text Generation
Library
onnxruntime-genai
License
llama3.2
Access
Public
Created
Jul 20, 2026
Updated
Oct 13, 2026
SHA
9368ade8

Try a prompt

Base models

Task
Text Generation
Library
onnxruntime-genai
License
llama3.2
Created
Jul 20, 2026
Updated
Oct 13, 2026