Downloads · 30 days
0
nla-ordered-features-av-sft
syvb/nla-ordered-features-av-sft
nla-ordered-features-av-sft is a machine learning model from syvb. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Activation Verbalizer after warm-start SFT (LoRA on Qwen3-8B, 4-bit).
Access
Public
Updated Jun 22, 2026
Repo size
502 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors491 MB · 97%
At a glance
- License
- mit
- Access
- Public
- Created
- Jun 22, 2026
- Updated
- Jun 22, 2026
- SHA
- f281e89b
Model card
From the Hugging Face model README
NLA ordered-features — av-sft
Activation Verbalizer after warm-start SFT (LoRA on Qwen3-8B, 4-bit).
Part of the NLA ordered-features (nested-dropout RL) PoC: an Activation
Verbalizer trained so its ~10 next-token-prediction features are ordered
most->least important, via random feature-prefix truncation (nested dropout)
during GRPO RL. Code: feat/nla-ordered-features-rl on
https://github.com/syvb/nanoNLA . Base model: Qwen/Qwen3-8B, layer 24.
Collection: https://huggingface.co/collections/syvb/nla-ordered-features-nested-dropout-rl-6a389fb18e68d281891e4061
- License
- mit
- Created
- Jun 22, 2026
- Updated
- Jun 22, 2026