Downloads · 30 days
52
10% of all-time downloads
Brooooooklyn/Qwen-AgentWorld-35B-A3B-UD-Q3_K_XL-mlx
Qwen-AgentWorld-35B-A3B-UD-Q3_K_XL-mlx is a image-text-to-text model from Brooooooklyn. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for mlx-node. The card lists the license as apache-2.0.
3-bit base mixed-precision quantization of Qwen/Qwen-AgentWorld-35B-A3B for Apple Silicon, using the Unsloth Dynamic per-tensor bit allocation with imatrix-AWQ pre-scaling via mlx-node.
Downloads · 30 days
52
10% of all-time downloads
All-time downloads
497
Public
Parameters
34.7B
17.3 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors17.3 GB · 100%
How the weights are stored.
U3234.7B · 100%
From the Hugging Face model README
3-bit base mixed-precision quantization of Qwen/Qwen-AgentWorld-35B-A3B for Apple Silicon, using the Unsloth Dynamic per-tensor bit allocation with imatrix-AWQ pre-scaling via mlx-node.
Qwen-AgentWorld-35B-A3B is the first native language world model for agentic environment simulation — a Qwen3.5-VL-MoE (hybrid Gated-DeltaNet + full attention, 256 experts, vision-language) that simulates agentic environments via long chain-of-thought reasoning, predicting the next environment state from an agent's action and interaction history. A single model spans seven interaction domains: MCP (tool calling), Search, Terminal, SWE, Android, Web, and OS. Trained CPT → SFT → RL on Qwen3.5-35B-A3B-Base. (technical report)
| Original (BF16) | This Model | |
|---|---|---|
| Size | ~65 GB | 17 GB |
| Format | SafeTensors (sharded) | SafeTensors (sharded) |
| Precision | BF16 uniform | Mixed 3/4/5/8-bit affine + BF16 (imatrix-AWQ) |
| Repo | Format | Size | Decode (tok/s) |
|---|---|---|---|
| Brooooooklyn/Qwen-AgentWorld-35B-A3B-UD-Q3_K_XL-mlx (this model) | UD-Q3_K_XL | 17 GB | 112.3 |
| Brooooooklyn/Qwen-AgentWorld-35B-A3B-mxfp4-mlx | MXFP4 | 21 GB | 102.6 |
| Brooooooklyn/Qwen-AgentWorld-35B-A3B-UD-Q4_K_XL-mlx | UD-Q4_K_XL | 22 GB | 99.8 |
| Brooooooklyn/Qwen-AgentWorld-35B-A3B-nvfp4-mlx | NVFP4 | 23 GB | 94.1 |
| Brooooooklyn/Qwen-AgentWorld-35B-A3B-UD-Q5_K_XL-mlx | UD-Q5_K_XL | 26 GB | 95.4 |
| Brooooooklyn/Qwen-AgentWorld-35B-A3B-UD-Q6_K_XL-mlx | UD-Q6_K_XL | 31 GB | 92.7 |
| Brooooooklyn/Qwen-AgentWorld-35B-A3B-mxfp8-mlx | MXFP8 | 36 GB | 91.0 |
| Brooooooklyn/Qwen-AgentWorld-35B-A3B-UD-Q8_K_XL-mlx | UD-Q8_K_XL | 37 GB | 91.1 |
Benchmarked on a cool Apple M5 Max: median decode throughput over three 512-token generations, with a 60-second idle GPU cooldown after every generation. (Sustained decode on Apple Silicon is thermally sensitive — back-to-back benchmarking on a hot chip can understate throughput by 20–30%, so every model here was measured from a comparable cool start.)
Steady-state decode: 112.3 tok/s (1.8x vs BF16) on Apple M5 Max. Decode is memory-bandwidth bound on Apple Silicon — fewer bytes per token directly translates to higher throughput. The MoE architecture activates only 8 of 256 experts per token (~3B active out of ~34.7B total), so the active-weight footprint streamed per token is what matters.
Decoded-text quality was verified against the BF16 reference with a multi-judge review of the actual generated output (not a heuristic): a multi-turn factual chat plus a structured reasoning/code task. This UD-Q3_K_XL build produced coherent prose, correct facts, and a correct implementation — no runaway generation, repetition loops, or stray tokens — on par with full precision.
| Weight | Bits | Rationale |
|---|---|---|
embed_tokens | 5-bit affine | KLD ~0.15 — very low sensitivity |
lm_head | 6-bit affine | KLD ~0.05 — safest tensor |
self_attn.q/k/v_proj | 5-bit affine | KLD ~1.5–2.9 — attention-sensitive |
linear_attn.in_proj_qkv/z | 5-bit affine | KLD ~2.9 — SSM input gates |
self_attn.o_proj | 8-bit affine | KLD ~1.5; row-independent qmv for T=0 exactness |
linear_attn.out_proj | 8-bit affine | KLD ~6.0 — worst tensor; kept high |
linear_attn.in_proj_a/b | 8-bit affine | tiny low-rank GDN projections |
switch_mlp.down_proj | 4-bit affine | "slightly more sensitive" than other FFN |
switch_mlp.gate_proj/up_proj | 3-bit affine | bulk of the expert budget |
Router gates (mlp.gate, shared_expert_gate) | 8-bit affine | MoE routing accuracy |
GDN params (A_log, dt_bias) | bf16 | state-space dynamics |
visual.* (vision tower) | bf16 | vision encoder kept full precision |
Built on Unsloth Dynamic 2.0 per-tensor KLD analysis: sensitive layers (attention/SSM inputs, down_proj, embeddings/head) get higher bits, while the bulk of FFN expert weights are quantized to the base width. self_attn.o_proj, linear_attn.out_proj, the split low-rank GDN projections (in_proj_a/b) and the MoE router gates are pinned to 8-bit affine (group_size 64). GatedDeltaNet state-space parameters and the vision encoder stay bf16.
imatrix-AWQ: unlike a plain affine quant, these builds apply imatrix activation-aware pre-scaling (AWQ-style) using the unsloth imatrix, so the attention/SSM channels that matter most are scaled before rounding — recovering quality at the lowest bit widths.
| Parameter | Value |
|---|---|
| Total parameters | ~34.7B (~3B active per token) |
| Hidden size | 2,048 |
| Layers | 40 (30 linear GatedDeltaNet + 10 full attention, interval 4) |
| Attention heads | 16 (2 KV heads, GQA 8:1) |
| Head dimension | 256 |
| Experts | 256 per MoE layer, top-8 routing |
| Vocab size | 248,320 |
| Vision | yes (Qwen3.5-VL vision tower, kept bf16) |
| Max context | 262,144 tokens |
import { loadSession } from '@mlx-node/lm';
const session = await loadSession('./Qwen-AgentWorld-35B-A3B-UD-Q3_K_XL-mlx');
for await (const event of session.sendStream('An agent runs `ls -la` in /home/user. Predict the terminal output and the resulting environment state.', {
config: { maxNewTokens: 2048, temperature: 0.6, reasoningEffort: 'low' },
})) {
if (!event.done) process.stdout.write(event.text);
}
mlx convert \
-i Qwen-AgentWorld-35B-A3B \
-o Qwen-AgentWorld-35B-A3B-UD-Q3_K_XL-mlx \
-q --q-recipe unsloth --q-bits 3\
--imatrix-path imatrix_unsloth.gguf_file
The Unsloth recipe's per-tensor bit tiers were applied with imatrix-AWQ pre-scaling (imatrix from unsloth/Qwen-AgentWorld-35B-A3B-GGUF), so activation-weighted channels are scaled before quantization. 7-bit tiers are snapped up to 8-bit (MLX affine supports 2/3/4/5/6/8-bit).
Apache-2.0 (inherited from base model).