Qwen-AgentWorld-35B-A3B-6bit-XL-mlx

leonsarmiento/Qwen-AgentWorld-35B-A3B-6bit-XL-mlx

This model was converted to MLX format from Qwen/Qwen-AgentWorld-35B-A3B using BaseQuant_XL 6/8-bit mixed quantization optimized for Apple Silicon.

BaseQuant_XL keeps the most routing-critical layers in full bf16 precision — the MoE router gate, shared expert gate, shared expert, and lm_head — while applying aggressive quantization to the bulk parameters. This preserves routing accuracy and output quality where it matters most.

About the Source Model

Qwen-AgentWorld-35B-A3B is the first language world model — a model that simulates agentic environments via long chain-of-thought reasoning. Instead of executing actions, it predicts the next environment state given an agent's action and interaction history.

Key facts:

• Architecture: Qwen3.5-35B-A3B-Base MoE (35B total / 3B active, 256 experts, 8 active + 1 shared)
• Training: CPT → SFT → RL (GSPO) — environment modeling is the core training objective, not a post-hoc adaptation
• Domains: 7 unified agent interaction domains — MCP (tool calling), Search, Terminal, SWE, Android, Web, OS
• Context: 262,144 tokens
• Output: Predicts next environment observation using <think>...</think> reasoning

Use with mlx

pip install -U mlx-vlm

python -m mlx_vlm.generate --model leonsarmiento/Qwen-AgentWorld-35B-A3B-6bit-XL-mlx --max-tokens 4096 --temperature 0.6 --top-p 0.95 --top-k 20 --prompt "Hello"

BaseQuant_XL Quantization Strategy

Quantization Details

• Quantization type: BaseQuant_XL mixed (text-only, vision tower absent)
• Bits per weight: 6.892
• Total size: ~28 GB (6 shards)
• Group size: 64
• Framework: mlx_vlm with strict=False (text-only checkpoint with VLM architecture — same pattern as KAT-Coder-V2.5-Dev)

Recommended Inference Parameters

Preserve thinking: This is a Qwen3.5 model. In LM Studio, enable preserve_thinking to capture reasoning content separately from output. Set chat_template_kwargs: {"preserve_thinking": true} in API payloads.

Text-only note: Although the config includes vision_config, the checkpoint contains only language model weights (no vision tower). Use with strict=False or --language-model-only in frameworks that check for vision components.

Flight Simulator Demo

AgentWorld-35B-A3B coding a flight simulator from scratch.

MLX Benchmarks (n=50, instruct mode)

AgentWorld leads the Qwen3.6 family on MMLU (+8 over base) and MMLU_PRO (+6), reflecting its deep training on agent interaction domains that overlap with knowledge and reasoning tasks. The ARC_CHALLENGE drop (74% vs 90%) is notable — the world-model fine-tuning trades commonsense reasoning strength for environment simulation capability. Coding benchmarks (HUMANEVAL 82%, MBPP 78%) are strong, consistent with its SWE/Terminal domain coverage.

About XL Quantization

BaseQuant_XL is a data-agnostic (static) quantization method — it allocates precision based on layer role in the architecture, not calibration data. Unlike data-dependent methods (iMatrix, AWQ, GPTQ, oQ, oQ4e) which use calibration datasets that can skew representation toward well-represented domains, XL quantization treats all tokens equally. This makes it suitable for general-purpose use without domain bias.