Downloads · 30 days
48
11% of all-time downloads
Mag-Mell-Reasoner-12B
ChaoticNeutrals/Mag-Mell-Reasoner-12B
Mag-Mell-Reasoner-12B is a machine learning model from ChaoticNeutrals. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
MMR-12B is based on MN-12B-Mag-Mell-R1 in ChatML format and was trained using 4-bit QLoRA. Reasoning is structured via <think...</think tags. Unlike the Violet Magcap series, this model has not been merged into any GR…
All-time downloads
433
Public
Parameters
12.2B
24.5 GB on disk
Likes
14
Public
Repo makeup
Click a slice to open those files.
.safetensors24.5 GB · 100%
At a glance
- License
- other
- Model type
- mistral
- Access
- Public
- Created
- May 3, 2025
- Updated
- May 6, 2025
- SHA
- b7db4c8c
Model card
From the Hugging Face model README
MMR-12B (Mag-Mell-Reasoner-12B)
MMR-12B is based on MN-12B-Mag-Mell-R1 in ChatML format and was trained using 4-bit QLoRA. Reasoning is structured via <think>...</think> tags. Unlike the Violet Magcap series, this model has not been merged into any GRPO (RLHF) model that uses the older <reasoning>...</reasoning> <answer>...</answer> formatting, nor has it undergone GRPO-style reinforcement training directly.
This run was redone after identifying RP formatting inconsistencies in later Magcap variants—specifically versions 1.5 and 1.9. Further updates in either series are unlikely for now, as I’m currently on hiatus to focus on other matters.
Dataset Composition
- 5,000 non-reasoning toxicity data entries
- 5,000 non-reasoning Reddit NSFW entries
- 2,200 non-reasoning entries from A.R.E.S (Army - Resistance - Energetics - Survival)
- 5,000 reasoning instruction data entries
- 2,225 RP reasoning data entries
Training Hyperparameters
- Epochs: 2
- Learning Rate: 2e-4
- Gradient Accumulation: 4
- Batch Size: 8
- LoRA Rank: 64
- LoRA Alpha: 64
- Type
- mistral
- License
- other
- Languages
- en
- Created
- May 3, 2025
- Updated
- May 6, 2025