Skip to content

SeanWang0027

student_prefix_polaris_15K_qwen3-4b_continual_Q_qwen3-32b_cutoff4096_epoch_1_mask

SeanWang0027/student_prefix_polaris_15K_qwen3-4b_continual_Q_qwen3-32b_cutoff4096_epoch_1_mask

student_prefix_polaris_15K_qwen3-4b_continual_Q_qwen3-32b_cutoff4096_epoch_1_mask is a text generation model from SeanWang0027. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.

Online ROSE. Qwen3-4B (student) trained on the continuations that Qwen3-32B (teacher) writes from the student's own 4096-token prefix, with cross-entropy applied only to the teacher's tokens.

Downloads · 30 days

5

2% of all-time downloads

All-time downloads

308

Public

Parameters

4.4B

8.8 GB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors8.8 GB · 100%

At a glance

Task
Text Generation
Library
transformers
License
apache-2.0
Model type
qwen3
Access
Public
Created
Aug 28, 2026
Updated
Aug 28, 2026
SHA
a1085f22

Try a prompt

Base models

Task
Text Generation
Library
transformers
Type
qwen3
License
apache-2.0
Languages
en
Created
Aug 28, 2026
Updated
Aug 28, 2026