Downloads · 30 days
0
nemotron-3.5-asr-streaming-0.6b-onnx-int4-cpu
DimQ1/nemotron-3.5-asr-streaming-0.6b-onnx-int4-cpu
nemotron-3.5-asr-streaming-0.6b-onnx-int4-cpu is a automatic speech recognition model from DimQ1. Use it when you need speech turned into text. The card lists the license as cc-by-nc-4.0.
INT4 k-quant quantized ONNX model converted from NVIDIA Nemotron 3.5 ASR Streaming 0.6B using Microsoft Olive.
Access
Public
Updated Jun 30, 2026
Repo size
793 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.data788 MB · 99%
At a glance
- Task
- Automatic Speech Recognition
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Jun 30, 2026
- Updated
- Jun 30, 2026
- SHA
- 0473ae0f
Model card
From the Hugging Face model README
Nemotron 3.5 ASR Streaming 0.6B — ONNX INT4 (CPU, fastest)
INT4 k-quant quantized ONNX model converted from NVIDIA Nemotron 3.5 ASR Streaming 0.6B using Microsoft Olive.
Fastest CPU inference — smallest model size, lowest latency. Best for real-time streaming ASR on CPU.
Model Details
| Property | Value |
|---|---|
| Base model | NVIDIA Nemotron 3.5 ASR Streaming 0.6B |
| Encoder layers | 24 |
| Hidden size | 1024 |
| Quantization | INT4 k-quant (block_size=32) |
| Chunk size | 0.56s (8,960 samples @ 16kHz) |
| Sample rate | 16,000 Hz |
| Vocab size | 13,088 |
| Languages | 80+ (multilingual) |
| VAD | Silero VAD included |
| Total size | ~757 MB |
Files
| File | Size |
|---|---|
encoder.onnx + .data | 658 MB |
decoder.onnx + .data | 57 MB |
joint.onnx + .data | 36 MB |
silero_vad.onnx | 2.1 MB |
tokenizer.json | 0.7 MB |
Available Variants
| Model | Precision | Encoder | Total Size | Quality |
|---|---|---|---|---|
| FP32 | FP32 | 2,380 MB | 2,479 MB | ⭐ Best |
| INT8 | INT8 k-quant | 922 MB | 1,021 MB | Good |
| INT4 | INT4 k-quant | 658 MB | 757 MB | ⚡ Fastest |
License
Inherits cc-by-nc-4.0 from NVIDIA.
- Task
- Automatic Speech Recognition
- License
- cc-by-nc-4.0
- Languages
- multilingual
- Created
- Jun 30, 2026
- Updated
- Jun 30, 2026