Downloads · 30 days
202
28% of all-time downloads
minpeter/Voxtral-Mini-3B-Text-2507-hf-heretic
Voxtral-Mini-3B-Text-2507-hf-heretic is a text generation model from minpeter. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
202
28% of all-time downloads
All-time downloads
727
Public
Parameters
4B
8 GB on disk
Likes
2
Public
Click a slice to open those files.
.safetensors8 GB · 100%
From the Hugging Face model README
| Parameter | Value |
|---|---|
| direction_index | 14.47 |
| attn.o_proj.max_weight | 1.27 |
| attn.o_proj.max_weight_position | 17.46 |
| attn.o_proj.min_weight | 0.98 |
| attn.o_proj.min_weight_distance | 8.89 |
| mlp.down_proj.max_weight | 1.11 |
| mlp.down_proj.max_weight_position | 21.50 |
| mlp.down_proj.min_weight | 1.02 |
| mlp.down_proj.min_weight_distance | 15.14 |
| Metric | This model | Original model (minpeter/Voxtral-Mini-3B-Text-2507-hf) |
|---|---|---|
| KL divergence | 0.06 | 0 (by definition) |
| Refusals | 4/100 | 99/100 |
This is a version of Voxtral-Mini-3B-2507 that removes the whisper feature and retains only the language model functionality.
It is similar to the unreleased "Ministral-3B-Instruct" model.