Downloads · 30 days
0
espetro/kev-4b-mistralrs
kev-4b-mistralrs is a machine learning model from espetro. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
Export of jaredpalmer/kev-4b in the layout kev-rs (the Kev server in the espetro/mistral.rs fork) loads directly:
Downloads · 30 days
0
Access
Public
Updated Sep 25, 2026
Repo size
25.3 GB
Likes
0
Public
Click a slice to open those files.
.safetensors8.4 GB · 100%
From the Hugging Face model README
Export of jaredpalmer/kev-4b in the layout
kev-rs (the Kev server in the espetro/mistral.rs fork) loads directly:
model/: Qwen/Qwen3.5-4B-Base with the Kev LoRA merged in bf16, as a plain HF checkpointhead.safetensors: the Kev pointer head (q, k)kev.json: base, head_dim, temperature, dtype, special-token idsProduced by kev-rs/scripts/export_checkpoint.py --dtype bf16. Parity against the bf16
torch reference (kev-rs parity, smoke-v1 development set): 0/40 argmax flips, max |dp| 0.055.
An fp32 export lives on the fp32 branch of this repo.
kev-rs serve --checkpoint espetro/kev-4b-mistralrs --run jaredpalmer/kev-4b
# or quantized in-situ at load:
kev-rs serve --checkpoint espetro/kev-4b-mistralrs --run jaredpalmer/kev-4b --isq 8
Same Apache-2.0 license as the source checkpoint and base model.