Downloads · 30 days
4
10% of all-time downloads
adaanchor-kv-qwen-2-1.5b
disha20041005/adaanchor-kv-qwen-2-1.5b
adaanchor-kv-qwen-2-1.5b is a machine learning model from disha20041005. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository contains the trained lightweight parameters for AdaAnchor-KV + Learned Halting.
All-time downloads
42
Public
Repo size
23.7 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.pt23.7 MB · 100%
At a glance
- Access
- Public
- Created
- Mar 6, 2026
- Updated
- Mar 6, 2026
- SHA
- 29d9a143
Model card
From the Hugging Face model README
AdaAnchor-KV — Qwen2.5-1.5B (Lightweight Weights)
This repository contains the trained lightweight parameters for AdaAnchor-KV + Learned Halting.
Backbone (frozen during training):
Qwen/Qwen2.5-1.5B-Instruct
What's inside
adaanchor_kv_weights.pt:anchors: learnable anchor vectors (m=8)proj: projection layer for anchor refinementln: layer norm for refinement updatehalt: learned halting head (stop probability)
config.json: training + method hyperparameters
Training summary
- Kmax: 6
- beta: 0.5
- lambda_cost: 0.02
- max_q_len: 192
- max_a_len: 32
Note: These are NOT full model weights. Load the backbone separately with Transformers, then load these lightweight weights to run AdaAnchor-KV refinement with KV caching.
- Created
- Mar 6, 2026
- Updated
- Mar 6, 2026