Downloads · 30 days
18
17% of all-time downloads
majentik/Nemotron-Cascade-2-30B-A3B-TurboQuant-MLX-4bit
Nemotron-Cascade-2-30B-A3B-TurboQuant-MLX-4bit is a text generation model from majentik. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as other.
nvidia/Nemotron-Cascade-2-30B-A3B quantized pack, published as Nemotron-Cascade-2-30B-A3B-TurboQuant-MLX-4bit.
Downloads · 30 days
18
17% of all-time downloads
All-time downloads
109
Public
Parameters
4.9B
17.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors17.8 GB · 100%
How the weights are stored.
U323.9B · 80%
From the Hugging Face model README
nvidia/Nemotron-Cascade-2-30B-A3B quantized pack, published as Nemotron-Cascade-2-30B-A3B-TurboQuant-MLX-4bit.
MLX quantization via mlx_lm (4bit, group_size 64).
Released under the TurboQuant line. RotorQuant and TurboQuant are this project's release labels for this pack, not distinct quantization algorithms — both brand repos carry byte-identical weights. No brand-specific speedup is claimed or measured.
pipeline_tag: text-generation.
This is a Mixture-of-Experts (MoE) model — a subset of experts is active per token; total and active parameter counts differ.
This pack is a derivative of nvidia/Nemotron-Cascade-2-30B-A3B; all credit for the original model, training, and weights belongs to the upstream authors. This repo republishes a quantized conversion of those weights only.
Governed by the nvidia-open-model-license. See the upstream repo and the linked license for the full terms — no license text is reproduced here.