Downloads · 30 days
0
TinyLlama-1.1B-Chat-v1.0-onnx-webgpu
lwanming/TinyLlama-1.1B-Chat-v1.0-onnx-webgpu
TinyLlama-1.1B-Chat-v1.0-onnx-webgpu is a machine learning model from lwanming. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Access
Public
Updated Oct 23, 2025
Repo size
619 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.data619 MB · 99%
At a glance
- License
- mit
- Access
- Public
- Created
- Oct 23, 2025
- Updated
- Oct 23, 2025
- SHA
- 3ec1fc3d
Model card
From the Hugging Face model README
license: apache-2.0
Base on https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0
Convert to onnx model using https://github.com/microsoft/onnxruntime-genai (commit: 74ec1becd9ca84099c2e8cfaa4798a8a9fc66beb)
Using command:
onnxruntime-genai\src\python\py\models> python builder.py -m TinyLlama/TinyLlama-1.1B-Chat-v1.0 \
-o model-output-path -c model-cache-dir -e webgpu -p int4 --extra_options int4_block_size=32 \
int4_accuracy_level=4 int4_op_types_to_quantize=MatMul/Gather
- License
- mit
- Created
- Oct 23, 2025
- Updated
- Oct 23, 2025