Downloads · 30 days
14
26% of all-time downloads
Ful3/Dark-Scarlett-v1.0-31B-FP8mlp-W4attn
Dark-Scarlett-v1.0-31B-FP8mlp-W4attn is a machine learning model from Ful3. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Quantized build for vLLM. Run with --language-model-only --kv-cache-dtype fp8.
Downloads · 30 days
14
26% of all-time downloads
All-time downloads
53
Public
Parameters
23.9B
29.6 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors29.6 GB · 100%
How the weights are stored.
F8_E4M320.8B · 87%
From the Hugging Face model README
Quantized build for vLLM. Run with --language-model-only --kv-cache-dtype fp8.