Skip to content

jayzou3773

less-is-moe-gemma-4-26b-a4b-s1-128-seq8192-intdim-e-50

jayzou3773/less-is-moe-gemma-4-26b-a4b-s1-128-seq8192-intdim-e-50

less-is-moe-gemma-4-26b-a4b-s1-128-seq8192-intdim-e-50 is a text generation model from jayzou3773. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.

This checkpoint was structurally pruned with the released Less-is-MoE mean-absolute-gradient method. It removes exactly 50% of routed-expert FFN neurons using 128 calibration samples from yentinglin/s1K-1.1-trl-format…

Downloads · 30 days

80

18% of all-time downloads

All-time downloads

455

Public

Parameters

13.8B

27.7 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors27.6 GB · 100%

At a glance

Task
Text Generation
License
apache-2.0
Model type
gemma4_text
Access
Public
Created
Sep 23, 2026
Updated
Sep 23, 2026
SHA
abecbd3d

Try a prompt

Base models

Task
Text Generation
Type
gemma4_text
License
apache-2.0
Created
Sep 23, 2026
Updated
Sep 23, 2026