Downloads · 30 days
18
18% of all-time downloads
majentik/Nemotron-Cascade-2-30B-A3B-RotorQuant-MLX-3bit
Nemotron-Cascade-2-30B-A3B-RotorQuant-MLX-3bit is a text generation model from majentik. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as other.
nvidia/Nemotron-Cascade-2-30B-A3B quantized pack, published as Nemotron-Cascade-2-30B-A3B-RotorQuant-MLX-3bit.
Downloads · 30 days
18
18% of all-time downloads
All-time downloads
98
Public
Parameters
4B
13.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors13.8 GB · 100%
How the weights are stored.
U323B · 75%
From the Hugging Face model README
nvidia/Nemotron-Cascade-2-30B-A3B quantized pack, published as Nemotron-Cascade-2-30B-A3B-RotorQuant-MLX-3bit.
MLX quantization via mlx_lm (3bit, group_size 64).
Released under the RotorQuant line. RotorQuant and TurboQuant are this project's release labels for this pack, not distinct quantization algorithms — both brand repos carry byte-identical weights. No brand-specific speedup is claimed or measured.
pipeline_tag: text-generation.
This is a Mixture-of-Experts (MoE) model — a subset of experts is active per token; total and active parameter counts differ.
This pack is a derivative of nvidia/Nemotron-Cascade-2-30B-A3B; all credit for the original model, training, and weights belongs to the upstream authors. This repo republishes a quantized conversion of those weights only.
Governed by the nvidia-open-model-license. See the upstream repo and the linked license for the full terms — no license text is reproduced here.