Skip to content

Arm

tinyllama-1-1b-chat-onnx-genai-int4-kquantlast-emb-int8-graviton-g4

Arm/tinyllama-1-1b-chat-onnx-genai-int4-kquantlast-emb-int8-graviton-g4

tinyllama-1-1b-chat-onnx-genai-int4-kquantlast-emb-int8-graviton-g4 is a text generation model from Arm. Use it when you need the model to write or continue text. It is set up for onnxruntime-genai. The card lists the license as apache-2.0.

A decoder-only chat language model for text generation, provided in ONNX for the ONNX Runtime GenAI runtime and quantized to INT4 groupwise asymmetric weights with INT8 per-token dynamic activations, INT8 per-row embe…

Downloads · 30 days

57

5% of all-time downloads

All-time downloads

1.2K

Public

Repo size

764 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.data763 MB · 99%

At a glance

Task
Text Generation
Library
onnxruntime-genai
License
apache-2.0
Model type
llama
Access
Public
Created
Jul 20, 2026
Updated
Oct 13, 2026
SHA
ee0ecbda

Try a prompt

Base models

Task
Text Generation
Library
onnxruntime-genai
Type
llama
License
apache-2.0
Created
Jul 20, 2026
Updated
Oct 13, 2026