Downloads · 30 days
22
3% of all-time downloads
qwen3.5-35b-a3b-code-extract-N128
deepgoyal19/qwen3.5-35b-a3b-code-extract-N128
qwen3.5-35b-a3b-code-extract-N128 is a text generation model from deepgoyal19. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
A training-free coding specialist extracted from Qwen/Qwen3.5-35B-A3B by analytically selecting which mixture-of-experts to keep — no fine-tuning, distillation, or gradient updates of any kind. Half the routed experts…
All-time downloads
741
Public
Parameters
18.5B
37.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors37.1 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen3_5_moe_text
- Access
- Public
- Created
- Aug 6, 2026
- Updated
- Aug 11, 2026
- SHA
- 6ae908b5
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.5-35B-A3B — Coding Extract (N128)
A training-free coding specialist extracted from Qwen/Qwen3.5-35B-A3B by analytically selecting which mixture-of-experts to keep — no fine-tuning, distillation, or gradient updates of any kind. Half the routed experts are removed; the always-on trunk (attention, shared expert, embeddings) is kept whole.
- Parameters: 18.54 B (parent: ~34.6 B) — 128 of 256 routed experts kept per layer
- Size: 37.1 GB (bf16,
model.safetensors) - Derived from: Qwen3.5-35B-A3B (hybrid linear-attention MoE, top-8 routing)
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
m = AutoModelForCausalLM.from_pretrained("deepgoyal19/qwen3.5-35b-a3b-code-extract-N128",
torch_dtype="bfloat16", device_map="auto")
tok = AutoTokenizer.from_pretrained("deepgoyal19/qwen3.5-35b-a3b-code-extract-N128")
Recommended coding config (from the parent's card): temperature=0.6, top_p=0.95, top_k=20, repetition_penalty=1.0, thinking mode on.
Evaluation
| Benchmark | pass@1 |
|---|---|
| HumanEval | 86.6% |
| HumanEval+ | 83.5% |
Provenance
census_export.json in this repo records the exact keep-set, N, selector, and parity metrics.
- Task
- Text Generation
- Library
- transformers
- Type
- qwen3_5_moe_text
- License
- apache-2.0
- Created
- Aug 6, 2026
- Updated
- Aug 11, 2026