Downloads · 30 days
11
1% of all-time downloads
magnum-v2-123b-fp8-dynamic
leafspark/magnum-v2-123b-fp8-dynamic
magnum-v2-123b-fp8-dynamic is a text generation model from leafspark. Use it when you need the model to write or continue text. The card lists the license as other.
Converted to fp8 dynamic by leafspark; original model link here: anthracite-org/magnum-v2-123b
All-time downloads
1.7K
Public
Parameters
123B
123 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors123 GB · 100%
Parameter types
How the weights are stored.
F8_E4M3122B · 99%
Try a prompt
Base models
Model card
From the Hugging Face model README
magnum-v2-123b-fp8-dynamic
This is the sixth in a series of models designed to replicate the prose quality of the Claude 3 models, specifically Sonnet and Opus.
This model is fine-tuned on top of [Mistral-Large-Instruct-2407](https://huggingface.co/mistralai/Mistral-Large-Instruct-2407).
Converted to fp8 dynamic by leafspark; original model link here: anthracite-org/magnum-v2-123b
Using 6xL40 on RunPod Ubuntu container; quantizaton took 30 minutes.
- Task
- Text Generation
- Type
- mistral
- License
- other
- Languages
- en, fr, de, es, it, pt
- Created
- Aug 28, 2024
- Updated
- Aug 30, 2024