Downloads · 30 days
32
3% of all-time downloads
qwen2-0.5b_numina_math-instruct-gguf
xsanskarx/qwen2-0.5b_numina_math-instruct-gguf
qwen2-0.5b_numina_math-instruct-gguf is a machine learning model from xsanskarx. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as cc-by-nc-nd-4.0.
This repository contains a gguf fine-tuned version of the Qwen-2 0.5B model specifically optimized for mathematical instruction understanding and reasoning. It builds upon the Numina dataset, which provides a rich sou…
All-time downloads
1.2K
Public
Repo size
994 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf994 MB · 100%
At a glance
- Library
- transformers
- License
- cc-by-nc-nd-4.0
- Model type
- qwen2
- Access
- Public
- Created
- Jul 23, 2024
- Updated
- Jul 23, 2024
- SHA
- f5afb819
Datasets
Model card
From the Hugging Face model README
xsanskarx/qwen2-0.5b_numina_math-instruct-gguf
This repository contains a gguf fine-tuned version of the Qwen-2 0.5B model specifically optimized for mathematical instruction understanding and reasoning. It builds upon the Numina dataset, which provides a rich source of mathematical problems and solutions designed to enhance reasoning capabilities even in smaller language models.
Motivation
My primary motivation is the hypothesis that high-quality datasets focused on mathematical reasoning can significantly improve the performance of smaller models on tasks that require logical deduction and problem-solving. Uploading comprehensive benchmarks is the next step in evaluating this claim.
Model Details
- Base Model: Qwen-2 0.5B
- Fine-tuning Dataset: Numina
- Key Improvements: Enhanced ability to parse mathematical instructions, solve problems, and provide step-by-step explanations.
- Library
- transformers
- Type
- qwen2
- License
- cc-by-nc-nd-4.0
- Created
- Jul 23, 2024
- Updated
- Jul 23, 2024