Downloads · 30 days
13
4% of all-time downloads
microsoft-rho-math-1b-v0.1
hflog/microsoft-rho-math-1b-v0.1
microsoft-rho-math-1b-v0.1 is a text generation model from hflog. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
The Rho-1 series are pretrained language models that utilize Selective Language Modeling (SLM) objectives. In math reasoning pretraining, SLM improves average few-shot accuracy on GSM8k and MATH by over 16%, achieving…
All-time downloads
356
Public
Parameters
1.1B
4.4 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Apr 12, 2024
- Updated
- Apr 12, 2024
- SHA
- 5574ecb6
Try a prompt
Model card
From the Hugging Face model README
Rho-1: Not All Tokens Are What You Need
The Rho-1 series are pretrained language models that utilize Selective Language Modeling (SLM) objectives. In math reasoning pretraining, SLM improves average few-shot accuracy on GSM8k and MATH by over 16%, achieving the baseline performance 5-10x faster.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- mit
- Languages
- en
- Created
- Apr 12, 2024
- Updated
- Apr 12, 2024