Downloads · 30 days
46
6% of all-time downloads
Nemotron-Cascade-2-30B-A3B-heretic-mlx-4bit
IvanSmit05/Nemotron-Cascade-2-30B-A3B-heretic-mlx-4bit
Nemotron-Cascade-2-30B-A3B-heretic-mlx-4bit is a text generation model from IvanSmit05. Use it when you need the model to write or continue text. It is set up for mlx.
license: other language: - en pipelinetag: text-generation tags: - mlx - safetensors - nemotronh - text-generation - conversational - customcode - 4-bit - heretic - uncensored - decensored - abliterated - basemodel:tr…
All-time downloads
784
Public
Parameters
31.6B
17.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors17.8 GB · 100%
Parameter types
How the weights are stored.
U3231.6B · 100%
Try a prompt
Model card
From the Hugging Face model README
license: other language:
- en pipeline_tag: text-generation tags:
- mlx
- safetensors
- nemotron_h
- text-generation
- conversational
- custom_code
- 4-bit
- heretic
- uncensored
- decensored
- abliterated
- base_model:trohrbaugh/Nemotron-Cascade-2-30B-A3B-heretic-uncensored
- base_model:quantized:trohrbaugh/Nemotron-Cascade-2-30B-A3B-heretic-uncensored
IvanSmit05/Nemotron-Cascade-2-30B-A3B-heretic-mlx-4bit
This model was converted to MLX format from trohrbaugh/Nemotron-Cascade-2-30B-A3B-heretic-uncensored using mlx-lm. Refer to the original model card for more details on the model.
Use with mlx
pip install -U mlx-lm
python -m mlx_lm.generate \
--model IvanSmit05/Nemotron-Cascade-2-30B-A3B-heretic-mlx-4bit \
--max-tokens 200 \
--temp 0.7 \
--prompt "Write a short story about a rogue AI."
- Task
- Text Generation
- Library
- mlx
- Type
- nemotron_h
- Languages
- en
- Created
- Apr 12, 2026
- Updated
- Apr 12, 2026