Skip to content

Arm

llama-3-1-8b-instruct-onnx-genai-int4-kquantlast-emb-int8

Arm/llama-3-1-8b-instruct-onnx-genai-int4-kquantlast-emb-int8

llama-3-1-8b-instruct-onnx-genai-int4-kquantlast-emb-int8 is a text generation model from Arm. Use it when you need the model to write or continue text. It is set up for onnxruntime-genai. The card lists the license as llama3.1.

A quantized version of meta-llama/Llama-3.1-8B-Instruct for text generation, provided in ONNX for the ONNX Runtime GenAI runtime with INT4 weights, dynamic INT8 activations and INT8 embeddings, and optimized for Arm-b…

Downloads · 30 days

62

37% of all-time downloads

All-time downloads

168

Public

Repo size

5.4 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.data5.4 GB · 100%

At a glance

Task
Text Generation
Library
onnxruntime-genai
License
llama3.1
Access
Public
Created
Jul 17, 2026
Updated
Oct 13, 2026
SHA
c5c948d1

Try a prompt

Base models

Task
Text Generation
Library
onnxruntime-genai
License
llama3.1
Created
Jul 17, 2026
Updated
Oct 13, 2026