Skip to content

fraQtl

qwen3-4b-instruct-2507-kv-sidecars

fraQtl/qwen3-4b-instruct-2507-kv-sidecars

qwen3-4b-instruct-2507-kv-sidecars is a machine learning model from fraQtl. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

Nine concurrent ≈128K-context users on one A100 at 134.1 tok/s aggregate decode, with nine distinct passkeys planted at placements spanning 0–100% of the context and 9/9 recovered exactly. fp16 holds 2 users without p…

Downloads · 30 days

23

33% of all-time downloads

All-time downloads

70

Public

Repo size

19.3 MB

Likes

1

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin18.9 MB · 97%

At a glance

License
apache-2.0
Model type
fraqtl-kv-sidecar
Access
Public
Created
Jul 2, 2026
Updated
Oct 25, 2026
SHA
f8b1d981

Base models

Type
fraqtl-kv-sidecar
License
apache-2.0
Languages
en, zh
Created
Jul 2, 2026
Updated
Oct 25, 2026