Downloads · 30 days
7
18% of all-time downloads
mathforge-qwen2.5-math-7b-qlora
arteeman/mathforge-qwen2.5-math-7b-qlora
mathforge-qwen2.5-math-7b-qlora is a text generation model from arteeman. Use it when you need the model to write or continue text. It is set up for peft.
This repository contains the PEFT/QLoRA adapter for MathForge, an experimental small language model trained to generate competition-math problems from a crux insight and two interacting mathematical techniques.
All-time downloads
40
Public
Repo size
173 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors162 MB · 93%
At a glance
- Task
- Text Generation
- Library
- peft
- Access
- Public
- Created
- Jul 13, 2026
- Updated
- Jul 13, 2026
- SHA
- da4ed173
Try a prompt
Base models
Model card
From the Hugging Face model README
MathForge Qwen2.5-Math-7B QLoRA
This repository contains the PEFT/QLoRA adapter for MathForge, an experimental small language model trained to generate competition-math problems from a crux insight and two interacting mathematical techniques.
Architecture
- Base: Qwen/Qwen2.5-Math-7B-Instruct
- Quantization during training: 4-bit NF4
- Adapter: rank-32 LoRA
- Training snapshot: 2,956 integrity-audited examples
- Epochs: 1
- Maximum sequence length: 1,536
This repository contains adapter weights only. The Qwen base weights must be loaded separately.
Evaluation
The current 24-pair exploratory pilot did not show MathForge beating Claude Opus 4.8. See the complete methodology, outputs, and limitations in the GitHub repository:
https://github.com/arteexu/mathforge
Limitations
The model can produce invalid mathematics, incorrect answers, incomplete solutions, and formatting failures. Generated problems require independent mathematical verification before use.
- Task
- Text Generation
- Library
- peft
- Created
- Jul 13, 2026
- Updated
- Jul 13, 2026