nemotron-3.5-asr-streaming-0.6b-onnx-fp32-cpu

Nemotron 3.5 ASR Streaming 0.6B — ONNX FP32 (CPU)

Full-precision FP32 ONNX model converted from NVIDIA Nemotron 3.5 ASR Streaming 0.6B using Microsoft Olive.

Maximum quality for CPU inference with ONNX Runtime GenAI. No quantization — pure FP32 weights.

Model Details

Quick Start

C# / .NET

using NemotronSpeech;

using var session = new ModelSession(
    modelPath: "DimQ1/nemotron-3.5-asr-streaming-0.6b-onnx-fp32-cpu",
    executionProvider: "cpu",
    langId: "11",  // Russian
    useVad: true
);

Python

import onnxruntime_genai as og

model = og.Model("DimQ1/nemotron-3.5-asr-streaming-0.6b-onnx-fp32-cpu")
processor = og.StreamingProcessor(model)
# ...

Files

Available Variants

License

Inherits cc-by-nc-4.0 from NVIDIA.