Downloads · 30 days
1.2K
5% of all-time downloads
choppedgarlic/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-4bit-MLX
Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-4bit-MLX is a text generation model from choppedgarlic. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
This is a 4-bit MLX quantization for Apple Silicon of AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16.
Downloads · 30 days
1.2K
5% of all-time downloads
All-time downloads
24K
Public
Parameters
26.9B
15.2 GB on disk
Likes
11
Public
Click a slice to open those files.
.safetensors15.1 GB · 100%
How the weights are stored.
U3226.9B · 100%
From the Hugging Face model README
This is a 4-bit MLX quantization for Apple Silicon of AEON-7/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF16.
Original Uncensored model made by @SpaceTimeViking , complete credit to him and all his work https://x.com/SpaceTimeViking
All model and fine-tuning credit belongs to the original author, AEON-7, and the upstream Qwen team. This repository only provides an MLX conversion and quantization for easier local use on Apple Silicon. No additional fine-tuning or intentional behavioral changes were made.
pip install -U mlx-lm
mlx_lm.chat \
--model choppedgarlic/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-4bit-MLX \
--max-tokens 8192 \
--temp 0.6 \
--top-p 0.95
The first launch downloads the model from Hugging Face. Later launches use the local Hugging Face cache.
Thinking enabled:
mlx_lm.server \
--model choppedgarlic/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-4bit-MLX \
--host 127.0.0.1 \
--port 8081 \
--max-tokens 8192 \
--temp 0.6 \
--top-p 0.95 \
--chat-template-args '{"enable_thinking":true}'
Thinking disabled:
mlx_lm.server \
--model choppedgarlic/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-4bit-MLX \
--host 127.0.0.1 \
--port 8081 \
--max-tokens 8192 \
--temp 0.6 \
--top-p 0.95 \
--chat-template-args '{"enable_thinking":false}'
The API base URL is then http://127.0.0.1:8081/v1.
mlx_lm.chatmlx_lm.server through its OpenAI-compatible APIvision_config or vision preprocessor
assets. Image input and image generation are not supported or claimed.Released under the Apache License 2.0, matching the source repository's declared license. See LICENSE.