Downloads · 30 days
33
2% of all-time downloads
Ichigec/SuperQwen-AgentWorld-35B-A3B-abliterated-APEX-I-Quality
SuperQwen-AgentWorld-35B-A3B-abliterated-APEX-I-Quality is a text generation model from Ichigec. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
This is an APEX-I-Quality quantized GGUF of SuperQwen-AgentWorld-35B-A3B-abliterated, a fused post-training checkpoint based on Qwen/Qwen-AgentWorld-35B-A3B.
Downloads · 30 days
33
2% of all-time downloads
All-time downloads
1.4K
Public
Repo size
22.8 GB
Likes
0
Public
Click a slice to open those files.
.gguf22.8 GB · 100%
From the Hugging Face model README
This is an APEX-I-Quality quantized GGUF of SuperQwen-AgentWorld-35B-A3B-abliterated, a fused post-training checkpoint based on Qwen/Qwen-AgentWorld-35B-A3B.
SuperQwen combines two post-training stages over the base Qwen-AgentWorld model:
The APEX-I-Quality quantization (Adaptive Precision for EXpert Models) uses importance-matrix-guided mixed precision:
| Metric | SuperQwen Q8_0 (35 GB) | APEX v3 (21 GB) | Δ |
|---|---|---|---|
| Perplexity | 5.837 | 5.870 | +0.033 (within noise) |
| Size | 35 GB | 21 GB | −40% smaller |
| Speed (tg128) | — | 40.2 t/s | — |
The v3 achieves virtually identical quality at 40% smaller size compared to Q8_0, making it the best quality-to-size ratio for this model.
All benchmarks on identical hardware (DGX Spark, NVIDIA GB10, 99 GPU layers) using the APEX eval suite for comparability.
| Metric | Qwen3.5 F16 | Qwen3.5 Q8_0 | Qwen3.5 APEX I-Q | Qwen3.6 Q8_0 | Qwen3.6 APEX I-Q | Our Q8_0 | Our APEX v1 | Our APEX v3 |
|---|---|---|---|---|---|---|---|---|
| Size | 65 GB | 34 GB | 21 GB | ~34 GB | 21 GB | 35 GB | 22 GB | 21 GB |
| PPL | 6.537 | 6.533 | 6.552 | 6.720 | 6.735 | 5.837 | 5.868 | 5.870 |
| HellaSwag | 82.5% | 83.0% | 83.5% | 82.5% | 82.5% | — | 82.75% | 82.50% |
| Winogrande | 74.5% | 75.3% | 74.5% | — | — | — | 75.50% | 75.50% |
| MMLU | 41.5% | 41.2% | 41.4% | — | — | — | 42.38% | 41.93% |
| ARC | 56.9% | 57.9% | 57.9% | — | — | — | 54.52% | 53.85% |
| tg128 (t/s) | 30.4 | 52.5 | 63.1 | 9.7* | 63.9 | — | 38.5 | 40.2 |
*Qwen3.6 Q8_0 tg128=9.7 — suspected different test configuration
| Parameter | Value |
|---|---|
| Architecture | Qwen3.5MoE |
| Total parameters | 35B |
| Activated parameters | 3B |
| Layers | 40 (10 full attention + 30 linear attention) |
| Experts | 256 (top-8 per token) |
| Context length | 262,144 tokens |
| Vocabulary | 248,320 |
| MTP layers | 1 |
# Download
hf download Ichigec/SuperQwen-AgentWorld-35B-A3B-abliterated-APEX-I-Quality \
--local-dir ./models/
# Run
llama-cli \
-m ./models/SuperQwen-APEX-I-Quality-v3.gguf \
-ngl 99 \
-c 32768 \
-p "You are a helpful AI assistant."
| File | Size | SHA256 |
|---|---|---|
SuperQwen-APEX-I-Quality-v3.gguf | 21.3 GB | afb6a47af5301e45d7e1de792e76d5611acb9d909b2a6d2a69fd645a12052162 |