Downloads · 30 days
17
17% of all-time downloads
MN-12B-Starcannon-v2-fp8-dynamic
nothingiisreal/MN-12B-Starcannon-v2-fp8-dynamic
MN-12B-Starcannon-v2-fp8-dynamic is a text generation model from nothingiisreal. Use it when you need the model to write or continue text. It is set up for transformers.
Dynamic FP8 quant of Starcannon v2 made with AutoFP8.
All-time downloads
99
Public
Parameters
12.2B
13.6 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors13.6 GB · 100%
Parameter types
How the weights are stored.
F8_E4M310.9B · 89%
Try a prompt
Model card
From the Hugging Face model README
Dynamic FP8 quant of Starcannon v2 made with AutoFP8.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- Created
- Aug 1, 2024
- Updated
- Aug 1, 2024