CSM-1B-MLX-8bit

aufklarer/CSM-1B-MLX-8bit

CSM-1B-MLX-8bit is a text-to-speech model from aufklarer. Use it when you need text read aloud. It is set up for mlx. The card lists the license as apache-2.0.

Sesame CSM-1B (Conversational Speech Model) converted to MLX (int8) for on-device speech generation on Apple Silicon. CSM is a Moshi-family codec model: a Llama-1B backbone predicts the zeroth Mimi codebook, a Llama-1…

Downloads · 30 days

27% of all-time downloads

All-time downloads

108

Public

Parameters

1.6B

2.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors2.1 GB · 99%

Parameter types

How the weights are stored.

U321.5B · 96%

Base models

sesame/csm-1b

Model card

From the Hugging Face model README

CSM-1B-MLX-8bit

Sesame CSM-1B (Conversational Speech Model) converted to MLX (int8) for on-device speech generation on Apple Silicon. CSM is a Moshi-family codec model: a Llama-1B backbone predicts the zeroth Mimi codebook, a Llama-100M decoder predicts the rest. It clones a voice from a short reference clip.

Property	Value
Parameters	1.5B class (backbone 1B + decoder + heads)
Quantization	int8
Size	~1.7 GB
Codec	Mimi, 32 codebooks @ 12.5 Hz, 24 kHz
Languages	English

Files

File	Description
`model.safetensors`	backbone + decoder + heads + embeddings (int8)
`config.json`	architecture + per-module quantization map
`mimi.safetensors`	Kyutai Mimi codec (32 codebooks)
`tokenizer.json`	Llama BPE tokenizer

Performance (M-series, mlx-swift)

Metric	Value
RTF (int8)	~0.5–0.9 (faster than real time)
First-audio latency (streaming)	~120 ms

Quantization lowers memory bandwidth, so int8/int5 are both smaller and faster than fp16 on Apple GPUs.

Usage (Swift)

import CSM

let pipeline = try await CSMPipeline(directory: modelDir)
let audio = pipeline.synthesize(
    text: "Hello from on-device speech.",
    refAudio: referenceSamples,           // 24 kHz mono
    refText: "transcript of the reference",
    temperature: 0.9, topK: 50)

Known limitations

English-focused; weak on other languages.
End-of-audio occasionally clips the final word — pad the text with a short trailing phrase, or trim to the last voiced frame.
Zero-shot cloning transfers voice identity but flattens prosody vs. a purpose-tuned reference.

Source

Converted from sesame/csm-1b (Apache-2.0).

Repo makeup

Parameter types

Base models

Model card

CSM-1B-MLX-8bit

Files

Performance (M-series, mlx-swift)

Usage (Swift)

Known limitations

Source

Links