Downloads · 30 days
8
8% of all-time downloads
GRPO-Gsmath-Llama-1B-IT
Cannae-AI/GRPO-Gsmath-Llama-1B-IT
GRPO-Gsmath-Llama-1B-IT is a text generation model from Cannae-AI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a fine-tuned version of meta-llama/Llama-3.2-1B! - recommended settings for inference: minp = 0.1 and temperature = 1.5 , Read this Tweet to understand why. - License : apache-2.0 We evaluate all models on GSM…
All-time downloads
104
Public
Parameters
1.2B
2.5 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors2.5 GB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Nov 24, 2025
- Updated
- Nov 24, 2025
- SHA
- 73ee20f4
Try a prompt
Base models
Datasets
Model card
From the Hugging Face model README
GRPO-Gsmath-Llama-1B-IT
Model Description:
This is a fine-tuned version of meta-llama/Llama-3.2-1B!
- recommended settings for inference: min_p = 0.1 and temperature = 1.5 , Read this Tweet to understand why.
- License : apache-2.0
Benchmarks:
We evaluate all models on GSM8K using the standard lm-eval 5-shot exact-match protocol. Under identical decoding and extraction settings,GsMath-Llama-1B-IT and GsMath-Llama-1B outperform Meta’s Llama-3.2-1B by 2x-4.75x ,demonstrating an improvement in small-model mathematical capability.
| Model | Params | GSM8K (5-shot, EM) |
|---|---|---|
| GRPO-Gsmath-Llama-1B-IT | 1B | 0.323 |
| GsMath-Llama-1B | 1B | 0.137 |
| Llama-3.2-1B | 1B | 0.068 |
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Nov 24, 2025
- Updated
- Nov 24, 2025