Downloads · 30 days
0
RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx
tsukuyomichan-omnivoice-full-finetune-onnx is a text-to-speech model from RabbitDaisuke. Use it when you need text read aloud. It is set up for onnxruntime. The card lists the license as other.
This branch contains the unquantized FP32 ONNX quality-baseline runtime.
Downloads · 30 days
0
Access
Public
Updated Aug 17, 2026
Repo size
5.9 GB
Likes
0
Public
Click a slice to open those files.
.data2.5 GB · 99%
From the Hugging Face model README
| Distribution profile | Hugging Face | Quantization |
|---|---|---|
| Mobile INT4 | mobile-int4 | LLM constant MatMul weights: 4-bit; activations/audio/Higgs remain FP32 |
| Mobile INT8 | mobile-int8 | LLM constant MatMul weights: 8-bit; activations/audio/Higgs remain FP32 |
| LLM FP16 | fp16 | Constant-weight LLM MatMul: FP16; all other LLM math + graph I/O/audio/Higgs: FP32 |
| FP32 baseline | main | None |
This branch contains the unquantized FP32 ONNX quality-baseline runtime.
This repository/branch is a browser/runtime mirror produced by DaisukeDaisuke/tsukuyomichan-omnivoice-onnx.
The converter is open source and its source code, release workflow, verification gates, and conversion scripts are available at: https://github.com/DaisukeDaisuke/tsukuyomichan-omnivoice-onnx
The corrected OmniVoice non-causal attention conversion and the resulting native-Python PoC path were also reviewed and validated with ChatGPT GPT-5.6 Sol high. This is an additional engineering review signal, not a substitute for the repository's reproducible numerical checks, SHA-256 verification, or runtime tests.
kizuna-intelligence/tsukuyomichan-omnivoice-full-finetunec1d7ff9477d0b21f220c58070da63355f69607e99ebaa8dd3bf35ceb6217cd19142bdabe6d6c044cca40672d2ae163d1a90ab47e5337ba6bfe0ab30725fed141678a054fbedbf7dagh-c95619cbee324a79705d2e34236a2c9315459837-31982413307-fp32c95619cbee324a79705d2e34236a2c931545983721fp32-unquantizedThe runtime is split into audio_embeddings_encoder, llm_decoder, audio_heads_decoder, and
higgs_decoder ONNX graphs with external data. The conversion workflow rejects INT4, INT8, GPTQ, FP16 and BF16 weights/operators and numerically compares exported components against their PyTorch outputs before publication. llm_decoder preserves OmniVoice's rank-4 Boolean non-causal attention mask and runs without KV cache; a 2-D causal/padding-mask LLM contract is rejected by the release gate.
You can run the browser PoC directly here:
https://daisukedaisuke.github.io/typed-voice/poc.html
The PoC downloads the converted runtime into persistent browser storage so it can be reused across reloads. The current FP32 runtime is about 2.4 GiB, so the first preparation consumes more than 2 GB of network transfer and persistent local storage. Make sure your connection and device have enough capacity before starting the download. Clearing this site's stored data removes the persistent model cache when you want to reclaim the space.
The browser app uses a Service Worker for the offline model-asset path, persistent Cache Storage,
and cross-origin isolation. The FP32 validated fast path uses a WebGPU + WebAssembly hybrid:
audio embeddings, the LLM, and audio heads run on WebGPU, while the Higgs waveform decoder runs on
WebAssembly because this preserves the clean reference audio quality. The LLM FP16 profile keeps the
same FP32 graph I/O contract as the FP32 baseline, uses FP16 MatMul weights/compute on the ordinary
WebGPU path, and returns each constant MatMul result to FP32 immediately so the remaining LLM math
stays FP32. It does not use MatMulNBits. ONNX Runtime Web's JSEP MatMulNBits path does not support the Mobile INT8 LLM on
WebGPU, so Mobile INT8 keeps the LLM on WASM while still allowing the unquantized audio embeddings and
audio heads to use WebGPU. Browser testing also found reproducible token divergence when the Mobile
INT4 LLM alone runs on WebGPU; Mobile INT4 therefore uses the same LLM-on-WASM hybrid while its
embeddings and heads remain on WebGPU. Browsers without the required WebGPU path fall back to
WebAssembly where supported.
These WAV files are generated on the GitHub Actions CPU runner with native Python + ONNX Runtime from
the finalized fp32-unquantized release artifacts. They are static sample files; the player below does not run
the model in the browser.
Text: 東京都税関関税許可局、関税許可を急遽却下
FP32: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/main/samples/01_customs_tariff_rejection.wav"></audio>
LLM FP16: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/fp16/samples/01_customs_tariff_rejection.wav"></audio>
Mobile INT8: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/mobile-int8/samples/01_customs_tariff_rejection.wav"></audio>
Mobile INT4: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/mobile-int4/samples/01_customs_tariff_rejection.wav"></audio>
Direct files: FP32 / LLM FP16 / Mobile INT8 / Mobile INT4
Text: WebAssemblyをLLMでVibe Coding中
FP32: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/main/samples/02_webassembly_vibe_coding.wav"></audio>
LLM FP16: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/fp16/samples/02_webassembly_vibe_coding.wav"></audio>
Mobile INT8: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/mobile-int8/samples/02_webassembly_vibe_coding.wav"></audio>
Mobile INT4: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/mobile-int4/samples/02_webassembly_vibe_coding.wav"></audio>
Direct files: FP32 / LLM FP16 / Mobile INT8 / Mobile INT4
Text: えへへ、見つけてくれたんだ!ずっとここで待ってたんだよ?
FP32: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/main/samples/03_found_me_waiting.wav"></audio>
LLM FP16: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/fp16/samples/03_found_me_waiting.wav"></audio>
Mobile INT8: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/mobile-int8/samples/03_found_me_waiting.wav"></audio>
Mobile INT4: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/mobile-int4/samples/03_found_me_waiting.wav"></audio>
Direct files: FP32 / LLM FP16 / Mobile INT8 / Mobile INT4
Text: Hey, you finally made it! How does it feel, looking back at everything we've been through?
FP32: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/main/samples/04_found_me_waiting_English.wav"></audio>
LLM FP16: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/fp16/samples/04_found_me_waiting_English.wav"></audio>
Mobile INT8: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/mobile-int8/samples/04_found_me_waiting_English.wav"></audio>
Mobile INT4: <audio controls src="https://huggingface.co/RabbitDaisuke/tsukuyomichan-omnivoice-full-finetune-onnx/resolve/mobile-int4/samples/04_found_me_waiting_English.wav"></audio>
Direct files: FP32 / LLM FP16 / Mobile INT8 / Mobile INT4
Use runtime-manifest.json for runtime asset sizes, SHA-256 audit values, and XXH3-128 browser integrity
values, and SHA256SUMS for the runtime Release file set. Browser clients intentionally use XXH3-128 for
both first-download and reload validation to avoid multi-GiB client-side SHA-256 work, while SHA-256 is
retained for CI and offline release auditing. Generated audio samples have their own samples/SAMPLES_SHA256SUMS. The GitHub Release
remains the audit/release archive; this Hugging Face repository is the CORS/Range-friendly browser
distribution mirror of the same verified files.
本ソフトウェアの音声合成には、フリー素材キャラクター「つくよみちゃん」(© Rei Yumesaki)が無料公開している音声データを使用しています。
このモデルは、つくよみちゃんというキャラクターの声をもとにした音声合成モデルです。 モデルの変換形式や配布形態が変わっても、誰の声をもとにしているのか分からなくならないよう、つくよみちゃん由来であることを明記しています。
■つくよみちゃんコーパス(CV.夢前黎) https://tyc.rei-yumesaki.net/material/corpus/
本モデルから出力した音声は、次の目的ではご利用いただけません。
※鑑賞用の作品として配布・販売していただくことは問題ございません。
出力音声の利用条件の詳細は、つくよみちゃんコーパスの利用規約をご確認ください。 https://tyc.rei-yumesaki.net/material/corpus/
つくよみちゃんのモデルそのものを素材として使用する場合(改変、ファインチューニング、他モデルとのマージ、再配布などを行う場合)、つくよみちゃんコーパスに由来する部分の取り扱いについては、つくよみちゃんコーパスの利用規約に従ってください。この規定は、派生ソフトや再配布されたデータにもコピーレフトされます。
https://tyc.rei-yumesaki.net/material/corpus/
The license: other metadata is intentional. This repository does not claim that conversion to ONNX
relicenses the voice checkpoint, Tsukuyomichan corpus-derived materials, upstream OmniVoice model,
Higgs Audio 2 materials, or Meta Llama 3 materials. Read TSUKUYOMICHAN_MODEL_CARD.md,
TSUKUYOMICHAN_MODEL_CARD_JA.md, OMNIVOICE_MODEL_CARD.md, OMNIVOICE_CODE_LICENSE.txt,
BOSON-HIGGS-AUDIO-2-LICENSE.txt, META-LLAMA-3-LICENSE.txt, and NOTICE.txt before use or
redistribution.