Skip to content

jayzou3773

less-is-moe-qwen3.5-122b-a10b-s1-128-seq8192-intdim-e-50

jayzou3773/less-is-moe-qwen3.5-122b-a10b-s1-128-seq8192-intdim-e-50

less-is-moe-qwen3.5-122b-a10b-s1-128-seq8192-intdim-e-50 is a text generation model from jayzou3773. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.

This checkpoint was structurally pruned with the released Less-is-MoE mean-absolute-gradient method. It removes exactly 50% of routed-expert FFN neurons using 128 calibration samples from yentinglin/s1K-1.1-trl-format…

Downloads · 30 days

23

6% of all-time downloads

All-time downloads

393

Public

Parameters

64.1B

128 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors128 GB · 100%

At a glance

Task
Text Generation
License
apache-2.0
Model type
qwen3_5_moe_text
Access
Public
Created
Sep 18, 2026
Updated
Sep 18, 2026
SHA
24ab353e

Try a prompt

Base models

Task
Text Generation
Type
qwen3_5_moe_text
License
apache-2.0
Created
Sep 18, 2026
Updated
Sep 18, 2026