Downloads · 30 days
2.3K
18% of all-time downloads
edp1096/Huihui-RadixArk-Qwen3.8-27B-abliterated-NVFP4
Huihui-RadixArk-Qwen3.8-27B-abliterated-NVFP4 is a image-text-to-text model from edp1096. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers.
See https://huggingface.co/RadixArk/Qwen3.8-27B-DSpark
Downloads · 30 days
2.3K
18% of all-time downloads
All-time downloads
13.2K
Public
Parameters
18.2B
21.9 GB on disk
Likes
1
Public
Click a slice to open those files.
.safetensors21.9 GB · 100%
How the weights are stored.
U89.2B · 49%
From the Hugging Face model README
sglang serve \
--trust-remote-code \
--model-path Qwen/Qwen3.8-27B-FP8 \
--tp-size 1 \
--speculative-algorithm DSPARK \
--speculative-draft-model-path RadixArk/Qwen3.8-27B-DSpark \
--speculative-dspark-block-size 7 \
--speculative-draft-model-quantization unquant \
--mamba-scheduler-strategy extra_buffer \
--attention-backend fa3
vllm serve /path/to/Qwen3.8-27B-GPTQ-Int4 \
--dtype bfloat16 \
--max-model-len 16384 \
--max-num-seqs 16 \
--gpu-memory-utilization 0.90 \
--kv-cache-dtype fp8 \
--block-size 64 \
--trust-remote-code \
--speculative-config '{
"method": "dspark",
"model": "/path/to/Qwen3.8-27B-DSpark-vLLM",
"num_speculative_tokens": 7,
"draft_sample_method": "probabilistic"
}'
Credit: