Downloads · 30 days
42
49% of all-time downloads
Nyx-RP-9B-Instruct-2608-v1-MLX-4bit
Atomheart-Father/Nyx-RP-9B-Instruct-2608-v1-MLX-4bit
Nyx-RP-9B-Instruct-2608-v1-MLX-4bit is a text generation model from Atomheart-Father. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
MLX 4-bit quantization of Indexnusrefather/Nyx-RP-9B-Instruct-2608-v1 (Qwen3.5-9B roleplay finetune), converted from GGUF (mradermacher/Nyx-RP-9B-Instruct-2608-v1-GGUF) with a bounded-memory GGUF → MLX transcoder.
All-time downloads
86
Public
Parameters
9B
5.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5 GB · 100%
Parameter types
How the weights are stored.
U329B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
Nyx-RP-9B-Instruct-2608-v1-MLX-4bit
MLX 4-bit quantization of Indexnusrefather/Nyx-RP-9B-Instruct-2608-v1 (Qwen3.5-9B roleplay finetune), converted from GGUF (mradermacher/Nyx-RP-9B-Instruct-2608-v1-GGUF) with a bounded-memory GGUF → MLX transcoder.
- Quantization: 4-bit, group size 64 (affine)
- Model size: ~4.7 GB
- Context length: 262144
Usage
Requires a recent mlx-lm that supports the qwen3_5 model type:
pip install -U mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("Atomheart-Father/Nyx-RP-9B-Instruct-2608-v1-MLX-4bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)
For chat, use the tokenizer's chat template:
from mlx_lm import load, generate
model, tokenizer = load("Atomheart-Father/Nyx-RP-9B-Instruct-2608-v1-MLX-4bit")
messages = [{"role": "user", "content": "hello"}]
prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
- Task
- Text Generation
- Library
- mlx
- Type
- qwen3_5
- License
- apache-2.0
- Created
- Sep 21, 2026
- Updated
- Sep 21, 2026