Downloads · 30 days
116
7% of all-time downloads
amit21186/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-6bit-MLX
Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-6bit-MLX is a text generation model from amit21186. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This is a 6-bit MLX quantization of DavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking, converted with Apple's mlx-lm for fast local inference on Apple Silicon.
Downloads · 30 days
116
7% of all-time downloads
All-time downloads
1.5K
Public
Parameters
39.1B
31.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors31.8 GB · 100%
How the weights are stored.
U3239.1B · 100%
From the Hugging Face model README
This is a 6-bit MLX quantization of DavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking, converted with Apple's mlx-lm for fast local inference on Apple Silicon.
All credit for the underlying model, fine-tuning, and merge work goes to DavidAU. This repository only contains a quantized MLX conversion. See the original model card for full details on training data, intended use, and capabilities.
Released under the same license as the base model: Apache 2.0.
mlx_lm.convert with -q --q-bits 6 (affine quantization, group size 64)pip install mlx-lm
mlx_lm.generate --model amit21186/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-6bit-MLX --prompt "Your prompt here"
Search this repo name in LM Studio's model search, or download and place the folder under LM Studio's local models directory.