Downloads · 30 days
1.4K
1% of all-time downloads
magnum-v2-12b-gguf
anthracite-org/magnum-v2-12b-gguf
magnum-v2-12b-gguf is a text generation model from anthracite-org. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This is the fourth in a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet and Opus. This model is fine-tuned on top of Mistral-Nemo-Base-2407.
All-time downloads
185K
Public
Repo size
52.1 GB
Likes
38
Public
Repo makeup
Click a slice to open those files.
.gguf52.1 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Aug 6, 2024
- Updated
- Aug 22, 2024
- SHA
- 0cb128bd
Try a prompt
Base models
Model card
From the Hugging Face model README
This repo contains GGUF quants of the model. If you need the original weights, please find them here.
This is the fourth in a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet and Opus. This model is fine-tuned on top of Mistral-Nemo-Base-2407.
Prompting
Model has been Instruct tuned with the ChatML formatting. A typical input would look like this:
"""<|im_start|>user
Hi there!<|im_end|>
<|im_start|>assistant
Nice to meet you!<|im_end|>
<|im_start|>user
Can I ask a question?<|im_end|>
<|im_start|>assistant
"""
Credits
- Stheno dataset (filtered)
- kalomaze/Opus_Instruct_25k
- Nopm/Opus_WritingStruct
- Gryphe/Sonnet3.5-SlimOrcaDedupCleaned (A ~16k rows subset)
- kalomaze/Opus_Instruct_3k
This model has been a team effort, and the credits goes to all members of Anthracite.
Training
The training was done for 2 epochs. We used 8x NVIDIA H100 Tensor Core GPUs for the full-parameter fine-tuning of the model.
Safety
...
- Task
- Text Generation
- License
- apache-2.0
- Languages
- en, fr, de, es, it, pt
- Created
- Aug 6, 2024
- Updated
- Aug 22, 2024