DictateASR0.5

DictateAI SenseVoice Small (Edge-Optimized ASR)

DictateAI SenseVoice is a privacy-first, on-device automatic speech recognition (ASR) model fine-tuned for high-accuracy voice dictation and real-time transcription on edge hardware (such as Raspberry Pi 5 CPU and NVIDIA GPUs).

It features LoRA-adapted acoustic representations over SenseVoiceSmall, delivering low latency, high noise tolerance, and real-time execution with an INT8 ONNX edge runtime.

---

Benchmark Results (Real Speech Measurements)

All metrics below were computed from genuine acoustic inference across real human speech datasets using jiwer.wer() and jiwer.cer():

---

Model Artifacts Included in this Repository

---

Usage

1. Fast Inference with FunASR (Python SDK)

from funasr import AutoModel

# Load the model directly from Hugging Face
model = AutoModel(
    model="YOUR_USERNAME/dictateai-sensevoice-small",
    trust_remote_code=True,
    device="cuda"  # or "cpu"
)

# Run recognition on an audio file
res = model.generate(
    input="path/to/audio.wav",
    language="auto",  # or "en", "de", "zh", etc.
    use_itn=True
)

print("Transcription:", res[0]["text"])

2. Edge Inference with ONNX Runtime (Raspberry Pi 5 / CPU)

import onnxruntime as ort
import numpy as np

# Load the dynamic INT8 quantized model
session_options = ort.SessionOptions()
session_options.intra_op_num_threads = 4

session = ort.InferenceSession("sensevoice_int8.onnx", session_options, providers=["CPUExecutionProvider"])

# Inputs:
# - speech: [Batch, Time, 560]
# - speech_lengths: [Batch]
# - language: [Batch] (0=auto, 1=zh, 2=en, 3=yue, 4=ja, 5=ko)
# - textnorm: [Batch] (15=with ITN, 14=woitn)

---

Training Details

• Base Architecture: SAN-M Encoder + CTC Projection Head (235M params)
• Fine-Tuning Method: LoRA (Rank $r=8$, $lpha=16$) on linear projection layers with AdamW and Cosine Annealing schedule.
• Privacy Guarantee: 100% on-device execution with zero cloud telemetry or audio streaming.