Downloads · 30 days
76
31% of all-time downloads
Nyx-RP-9B-Instruct-2608-v1-MLX-6bit
Atomheart-Father/Nyx-RP-9B-Instruct-2608-v1-MLX-6bit
Nyx-RP-9B-Instruct-2608-v1-MLX-6bit is a text generation model from Atomheart-Father. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
MLX 6-bit quantization of Indexnusrefather/Nyx-RP-9B-Instruct-2608-v1 (Qwen3.5-9B roleplay finetune), converted from GGUF (mradermacher/Nyx-RP-9B-Instruct-2608-v1-GGUF) with a bounded-memory GGUF → MLX transcoder.
All-time downloads
243
Public
Parameters
9B
7.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors7.3 GB · 100%
Parameter types
How the weights are stored.
U329B · 100%
Try a prompt
Base models
Model card
From the Hugging Face model README
Nyx-RP-9B-Instruct-2608-v1-MLX-6bit
MLX 6-bit quantization of Indexnusrefather/Nyx-RP-9B-Instruct-2608-v1 (Qwen3.5-9B roleplay finetune), converted from GGUF (mradermacher/Nyx-RP-9B-Instruct-2608-v1-GGUF) with a bounded-memory GGUF → MLX transcoder.
- Quantization: 6-bit, group size 64 (affine)
- Model size: ~6.8 GB
- Context length: 262144
Usage
Requires a recent mlx-lm that supports the qwen3_5 model type:
pip install -U mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("Atomheart-Father/Nyx-RP-9B-Instruct-2608-v1-MLX-6bit")
response = generate(model, tokenizer, prompt="hello", verbose=True)
For chat, use the tokenizer's chat template:
from mlx_lm import load, generate
model, tokenizer = load("Atomheart-Father/Nyx-RP-9B-Instruct-2608-v1-MLX-6bit")
messages = [{"role": "user", "content": "hello"}]
prompt = tokenizer.apply_chat_template(messages, add_generation_prompt=True, tokenize=False)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
- Task
- Text Generation
- Library
- mlx
- Type
- qwen3_5
- License
- apache-2.0
- Created
- Sep 21, 2026
- Updated
- Sep 21, 2026