Downloads · 30 days
292
100% of all-time downloads
liodon-ai/zero-ONNX
zero-ONNX is a text generation model from liodon-ai. Use it when you need the model to write or continue text. It is set up for onnx. The card lists the license as other.
ONNX export of movingcastles/zero, published by Liodon AI. Exported with optimum (optimum.exporters.onnx.mainexport, task text-generation-with-past, so the graph exposes past-key-value inputs/outputs for KV-cached
Downloads · 30 days
292
100% of all-time downloads
All-time downloads
292
Public
Repo size
50.4 GB
Likes
0
Public
Click a slice to open those files.
.onnx_data50.4 GB · 100%
From the Hugging Face model README
ONNX export of movingcastles/zero, published by Liodon AI.
Exported with optimum (optimum.exporters.onnx.main_export,
task text-generation-with-past, so the graph exposes past-key-value inputs/outputs for KV-cached
autoregressive decoding).
| File | Size | Notes |
|---|---|---|
model.onnx | 32.76 GB | FP32, full precision |
model_fp16.onnx | 17.59 GB | FP16, for GPU execution providers |
import onnxruntime as ort
from transformers import AutoTokenizer
tok = AutoTokenizer.from_pretrained("liodon-ai/zero-ONNX")
sess = ort.InferenceSession("model_quantized.onnx", providers=["CPUExecutionProvider"])
# past_key_values.*.key / .value inputs must be supplied (zero-length tensors
# for the first forward pass) -- see optimum's ORTModelForCausalLM for a
# ready-made wrapper that handles KV-cache bookkeeping automatically:
# from optimum.onnxruntime import ORTModelForCausalLM
# model = ORTModelForCausalLM.from_pretrained("liodon-ai/zero-ONNX", file_name="model_quantized.onnx")
@misc{liodonai_zero_onnx,
title = {zero — ONNX},
author = {{Liodon AI}},
year = {2026},
howpublished = {\url{https://huggingface.co/liodon-ai/zero-ONNX}},
note = {ONNX export of movingcastles/zero}
}
Exported by Liodon AI