Downloads · 30 days
0
Luigi/x-asr-zh-en-streaming-ntuml2021-ft-demo
x-asr-zh-en-streaming-ntuml2021-ft-demo is a automatic speech recognition model from Luigi. Use it when you need speech turned into text. It is set up for sherpa-onnx. The card lists the license as apache-2.0.
⚠️ This is a research demonstration, not a production model. It exists to show that the X-ASR streaming zipformer2 transducer can be fine-tuned end-to-end and re-deployed to a Jetson Nano. It is a fine-tune of the bas…
Downloads · 30 days
0
Access
Public
Updated Jun 21, 2026
Repo size
169 MB
Likes
0
Public
Click a slice to open those files.
.onnx169 MB · 100%
From the Hugging Face model README
⚠️ This is a research demonstration, not a production model. It exists to show that the X-ASR streaming zipformer2 transducer can be fine-tuned end-to-end and re-deployed to a Jetson Nano. It is a fine-tune of the base (non-punctuation) X-ASR checkpoint on a small, single-domain set (NTU "Machine Learning 2021" lectures), so its gains are in-domain adaptation — it is not a generally-better zh-TW model and not a drop-in replacement for the deployed X-ASR model. Read the numbers below with the caveats.
Part of the jetson-stt project (on-edge zh-TW/en STT for a
2-core Jetson Nano attendant).
GilgameshWind/X-ASR-zh-en base / non-punctuation checkpoint (streaming_exp/pretrained.pt,
tokenizer lang_5000), a causal streaming zipformer2 transducer (6 stacks / 19 layers,
dims 192·256·512·768·512·256, vocab 5000, 16 kHz / 80-d fbank).s2twp downstream for Taiwan-Traditional output.| metric (40-clip slices) | base | this FT |
|---|---|---|
| Taiwan zh-en CS — MER (NTUML2021, in-domain) | 0.411 | 0.125 (−70 %) |
| English WER — clean held-out (LibriSpeech, not in FT data) | 0.064 | 0.061 (unchanged — no forgetting) |
| RTF @ 2 threads | 0.579 | 0.583 (unchanged — zero budget cost) |
docs/PHASE0_RESULTS.md).import sherpa_onnx
rec = sherpa_onnx.OnlineRecognizer.from_transducer(
tokens="tokens.txt", encoder="encoder.int8.onnx",
decoder="decoder.onnx", joiner="joiner.int8.onnx",
num_threads=2, provider="cpu", decoding_method="greedy_search")
Apache-2.0, following upstream X-ASR / icefall / k2 (k2-fsa). Fine-tuning data: NTUML2021
(ky552/ML2021_ASR_ST) + LibriSpeech (CC-BY) + FLEURS (CC-BY) retention. Recipe & full results:
vieenrose/jetson-stt (docs/FINETUNE_RESULTS.md).