Downloads · 30 days
105
5% of all-time downloads
o4-mini-high-gemma3-12B-distilled
mfielding92/o4-mini-high-gemma3-12B-distilled
o4-mini-high-gemma3-12B-distilled is a machine learning model from mfielding92. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
2.2K
Public
Repo size
12.5 GB
Likes
7
Public
Repo makeup
Click a slice to open those files.
.gguf12.5 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Apr 17, 2025
- Updated
- Jun 5, 2026
- SHA
- 0dbd77ab
Base models
Datasets
Model card
From the Hugging Face model README
OpenAI o4 Mini High
Distilled - Gemma 3 12B
Overview
This model is a Gemma 3 12B variant distilled from OpenAI's o4 Mini High. It was fine-tuned to emulate o4 Mini's depth and structured clarity, particularly in tasks involving complex thought, such as problem-solving, coding, and mathematics.
Technical Details
- Developed by: mfielding92
- Base Model: google/gemma-3-12b-it
- Training Speed Enhancement: Trained 2x faster with Unsloth and Huggingface's TRL library
Training Data
The model was trained on:
- mfielding92/o4-mini-high-100x
This dataset consists of 100 high-quality o4 Mini High completions responding to deep questions, solving math problems, and writing or analyzing code. The aim was to distill o4 Mini's analytical approach and technical versatility into a smaller, accessible model.
This Gemma model was trained 2x faster with Unsloth and Huggingface's TRL library.
<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>
- Library
- transformers
- License
- apache-2.0
- Languages
- en
- Created
- Apr 17, 2025
- Updated
- Jun 5, 2026