Downloads · 30 days
20
18% of all-time downloads
Cannae-AI/GsMath-Llama-1B
GsMath-Llama-1B is a text generation model from Cannae-AI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is a fine-tuned version of unsloth/Llama-3.2-1B! - recommended settings for inference: minp = 0.1 and temperature = 1.5 , Read this Tweet to understand why. - License : apache-2.0 - Finetuned from model : unsloth…
Downloads · 30 days
20
18% of all-time downloads
All-time downloads
111
Public
Parameters
1.2B
2.5 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.5 GB · 99%
From the Hugging Face model README
This is a fine-tuned version of unsloth/Llama-3.2-1B!
We evaluate both models on GSM8K using the standard lm-eval 5-shot exact-match protocol. Under identical decoding and extraction settings,GsMath-Llama-1B outperforms Meta’s Llama-3.2-1B by 2x,demonstrating an improvement in small-model mathematical capability.
| Model | Params | GSM8K (5-shot, EM) |
|---|---|---|
| GsMath-Llama-1B | 1B | 0.137 |
| Llama-3.2-1B | 1B | 0.068 |