Downloads · 30 days
47
5% of all-time downloads
adamo1139/DeepSeek-V2.5-1210-AWQ
DeepSeek-V2.5-1210-AWQ is a machine learning model from adamo1139. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Downloads · 30 days
47
5% of all-time downloads
All-time downloads
961
Public
Parameters
236B
129 GB on disk
Likes
3
Public
Click a slice to open those files.
.safetensors129 GB · 100%
How the weights are stored.
I32235B · 100%
From the Hugging Face model README
AWQ quantization of DeepSeek-V2.5-1210
To run on 8xH100 80GB, you can use vLLM with:
vllm serve adamo1139/DeepSeek-V2.5-1210-AWQ --tensor-parallel 8 --trust-remote-code