Skip to content

arianraje

qwen3-4b-mamba2-hybrid-stage2a-kd

arianraje/qwen3-4b-mamba2-hybrid-stage2a-kd

qwen3-4b-mamba2-hybrid-stage2a-kd is a text generation model from arianraje. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Stage-2a endpoint -- forward-KL logit knowledge distillation against Qwen3-4B over the full 151,936-token vocabulary, teacher-forced at temperature 1, sequence length 4096, 600M tokens (601,882,624 consumed). Unlike s…

Downloads · 30 days

17

3% of all-time downloads

All-time downloads

495

Public

Parameters

4.5B

8.9 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors8.9 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
qwen3_mamba2
Access
Public
Created
Aug 29, 2026
Updated
Aug 29, 2026
SHA
ba1383aa

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen3_mamba2
License
apache-2.0
Created
Aug 29, 2026
Updated
Aug 29, 2026