Downloads · 30 days
9
4% of all-time downloads
ArtusDev/TheDrummer_Cydonia-24B-v4.1-FP8-Dynamic
TheDrummer_Cydonia-24B-v4.1-FP8-Dynamic is a machine learning model from ArtusDev. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
FP8-Dynamic quant of TheDrummer/Cydonia-24B-v4.1 using <a href="https://github.com/vllm-project/llm-compressor/"llm-compressor</a for quantization.
Downloads · 30 days
9
4% of all-time downloads
All-time downloads
215
Public
Parameters
23.6B
24.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors24.9 GB · 100%
How the weights are stored.
F8_E4M322.2B · 94%
From the Hugging Face model README
FP8-Dynamic quant of TheDrummer/Cydonia-24B-v4.1 using <a href="https://github.com/vllm-project/llm-compressor/">llm-compressor</a> for quantization.