Downloads · 30 days
0
nemotron-speech-streaming-en-0.6b-int4
lokkju/nemotron-speech-streaming-en-0.6b-int4
nemotron-speech-streaming-en-0.6b-int4 is a machine learning model from lokkju. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
Quantized ONNX model for streaming speech recognition, derived from altunenes/parakeet-rs (nemotron-speech-streaming-en-0.6b).
Access
Public
Updated Jan 30, 2026
Repo size
662 MB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.onnx662 MB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Jan 30, 2026
- Updated
- Jan 30, 2026
- SHA
- d06c845d
Base models
Model card
From the Hugging Face model README
nemotron-speech-streaming-en-0.6b-int4
Quantized ONNX model for streaming speech recognition, derived from altunenes/parakeet-rs (nemotron-speech-streaming-en-0.6b).
Quantization Method
Weight-only int4 quantization (onnxruntime MatMul4BitsQuantizer)
Files
| File | Description |
|---|---|
encoder.onnx | Quantized encoder (stateful, cache-aware streaming) |
decoder_joint.onnx | Quantized decoder + joint network |
tokenizer.model | SentencePiece tokenizer (unchanged from source) |
Usage
These models are designed for use with parakeet-rs
or compatible ONNX Runtime inference pipelines. The encoder is stateful with cache tensors
for streaming inference (cache_last_channel, cache_last_time, cache_last_channel_len).
Source
Quantized from the ONNX models in altunenes/parakeet-rs
subdirectory nemotron-speech-streaming-en-0.6b/.
- License
- other
- Created
- Jan 30, 2026
- Updated
- Jan 30, 2026