Downloads · 30 days
6
10% of all-time downloads
valdanito/DASD-30B-A3B-Thinking-Preview-FP8-DYNAMIC
DASD-30B-A3B-Thinking-Preview-FP8-DYNAMIC is a text generation model from valdanito. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview quantized with LLM Compressor with FP8 W8A8. The model has been created and tested by The Valdanito. The model is compatible with SGlang v0.5.7. Tested with an NVID…
Downloads · 30 days
6
10% of all-time downloads
All-time downloads
61
Public
Parameters
30.5B
40.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors40.9 GB · 100%
How the weights are stored.
F8_E4M320.2B · 66%
From the Hugging Face model README
This is Alibaba-Apsara/DASD-30B-A3B-Thinking-Preview quantized with LLM Compressor with FP8 W8A8. The model has been created and tested by The Valdanito. The model is compatible with SGlang v0.5.7. Tested with an NVIDIA H800.