Downloads · 30 days
26
28% of all-time downloads
SpermLLM-S1-Ministral3-4B
SpermAI/SpermLLM-S1-Ministral3-4B
SpermLLM-S1-Ministral3-4B is a machine learning model from SpermAI. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
A fine-tuned version of Ministral-3-3B-Instruct-2512 trained with Unsloth on a carefully curated mix of SOTA reasoning and instruction-following datasets.
All-time downloads
92
Public
Repo size
7.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf7.7 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Feb 23, 2026
- Updated
- Feb 23, 2026
- SHA
- fab3d404
Base models
Model card
From the Hugging Face model README
SpermLLM Ministral3 3B
A fine-tuned version of Ministral-3-3B-Instruct-2512 trained with Unsloth on a carefully curated mix of SOTA reasoning and instruction-following datasets.
Optimized for math, code, science, and general reasoning — competitive with models 2-3x its size.
Model Details
| Property | Value |
|---|---|
| Base Model | mistralai/Ministral-3-3B-Instruct-2512 |
| Model Type | Causal Language Model (Decoder-only) |
| Parameters | 3.84B |
| Trainable Parameters | 135M (3.39% via LoRA) |
| Architecture | Mistral with Sliding Window Attention |
| Context Length | 8,192 tokens |
| Training Hardware | NVIDIA B200 (180GB VRAM) |
| Training Framework | Unsloth + TRL SFTTrainer |
| Precision | BFloat16 |
| Quantization | 4-bit QLoRA during training |
| License | Apache 2.0 |
This AI is (sorta SOTA) for it's size, as it can create multiple stuff without errors, this is our latest model
- License
- apache-2.0
- Languages
- en
- Created
- Feb 23, 2026
- Updated
- Feb 23, 2026