Skip to content

Arm

llama-3-1-8b-base-onnx-genai-int4-kquantlast-emb-int8

Arm/llama-3-1-8b-base-onnx-genai-int4-kquantlast-emb-int8

llama-3-1-8b-base-onnx-genai-int4-kquantlast-emb-int8 is a text generation model from Arm. Use it when you need the model to write or continue text. It is set up for onnxruntime-genai. The card lists the license as llama3.1.

A quantized version of meta-llama/Llama-3.1-8B for text generation, provided in ONNX for the ONNX Runtime GenAI runtime with INT4 weights, dynamic INT8 activations and INT8 embeddings, and optimized for Arm-based Clou…

Downloads · 30 days

49

26% of all-time downloads

All-time downloads

188

Public

Repo size

5.7 GB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.data5.7 GB · 100%

At a glance

Task
Text Generation
Library
onnxruntime-genai
License
llama3.1
Access
Public
Created
Jul 17, 2026
Updated
Oct 13, 2026
SHA
e5619fcc

Try a prompt

Base models

Task
Text Generation
Library
onnxruntime-genai
License
llama3.1
Created
Jul 17, 2026
Updated
Oct 13, 2026