Downloads · 30 days
47
8% of all-time downloads
siendsi/Qwen3-6-KMP-Dev-MLX-2bit
Qwen3-6-KMP-Dev-MLX-2bit is a text generation model from siendsi. Use it when you need the model to write or continue text. It is set up for mlx. The card lists the license as apache-2.0.
A pruned Qwen3.6-35B-A3B model optimized for Kotlin Multiplatform development and agentic tool use, converted to MLX 2-bit format.
Downloads · 30 days
47
8% of all-time downloads
All-time downloads
604
Public
Repo size
6.7 GB
Likes
0
Public
Click a slice to open those files.
.safetensors6.7 GB · 100%
From the Hugging Face model README
A pruned Qwen3.6-35B-A3B model optimized for Kotlin Multiplatform development and agentic tool use, converted to MLX 2-bit format.
License: Apache 2.0. Based on Qwen3.6-35B-A3B by Alibaba Cloud (Apache 2.0). Modified via expert pruning.
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("siendsi/Qwen3-6-KMP-Dev-MLX-2bit")
response = generate(model, tokenizer, "Write a Kotlin function to parse JSON")
print(response)
Search for siendsi/Qwen3-6-KMP-Dev-MLX-2bit in LM Studio.
| Variant | Format | Size | Quality |
|---|---|---|---|
| GGUF Q3_K_M | GGUF | 9.7GB | ~90% of original |
| GGUF Q2_K | GGUF | 7.6GB | ~75% of original |
| GGUF IQ1_M | GGUF | 4.9GB | ~60% of original, loops on tool use |
| MLX 2-bit | safetensors | 6.3GB | ~75% of original |