Downloads · 30 days
0
lwanming/TinyLlama-1.1B-Chat-v1.0-onnx
TinyLlama-1.1B-Chat-v1.0-onnx is a machine learning model from lwanming. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Base on https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0
Downloads · 30 days
0
Access
Public
Updated May 27, 2026
Repo size
1.4 GB
Likes
0
Public
Click a slice to open those files.
.data713 MB · 99%
From the Hugging Face model README
Base on https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0
Convert to onnx model using https://github.com/microsoft/onnxruntime-genai
Using command: python -m onnxruntime_genai.models.builder -m TinyLlama/TinyLlama-1.1B-Chat-v1.0 -o path-to-onnx-model -e webgpu -c cache-dir -p int4 --extra_options int4_block_size=32 int4_accuracy_level=4