Downloads · 30 days
85
6% of all-time downloads
Qwen2.5-3B-Instruct-Math-Reasoning-GGUF
ugriffo/Qwen2.5-3B-Instruct-Math-Reasoning-GGUF
Qwen2.5-3B-Instruct-Math-Reasoning-GGUF is a machine learning model from ugriffo. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
[!IMPORTANT] Disclaimer: The model has been trained on AWS on an Instance type g4dn.4xlarge (Tesla T4. Num GPUs = 1. Max memory: 14.563 GB. Platform: Linux. Torch: 2.6.0+cu124. CUDA: 7.5. CUDA Toolkit: 12.4. Triton: 3…
All-time downloads
1.3K
Public
Repo size
27.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf13.6 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Jul 3, 2025
- Updated
- Jul 7, 2025
- SHA
- 6c5434c8
Base models
Datasets
Spaces
Model card
From the Hugging Face model README
[!IMPORTANT] Disclaimer: The model has been trained on AWS on an Instance type
g4dn.4xlarge(Tesla T4. Num GPUs = 1. Max memory: 14.563 GB. Platform: Linux. Torch: 2.6.0+cu124. CUDA: 7.5. CUDA Toolkit: 12.4. Triton: 3.2.0).
Model Details
Trained a math reasoning model, converting a standard model Qwen2.5 3B Instruct into a math reasoning model using GRPO (Group Relative Policy Optimization),
a reinforcement learning algorithm that optimizes responses using reward functions.
Defined the rewarding functions to let the model learn how to reason on them, we fine-tuned Qwen2.5 3B Instruct on OpenAI's GSM8K dataset,
which contains grade school math problems.
The training took 10h on a Tesla T4. You can find the code used to train the model here.
Uploaded model
- Developed by: ugriffo
- License: apache-2.0
- Finetuned from model : unsloth/qwen2.5-3b-instruct-unsloth-bnb-4bit
This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Library
- transformers
- Type
- qwen2
- License
- apache-2.0
- Languages
- en
- Created
- Jul 3, 2025
- Updated
- Jul 7, 2025