Downloads · 30 days
87
13% of all-time downloads
Qwen3.8-27B-NVFP4
Preyazz/Qwen3.8-27B-NVFP4
Qwen3.8-27B-NVFP4 is a image-text-to-text model from Preyazz. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
NVFP4 (4-bit, compressed-tensors nvfp4-pack-quantized) weight quantization of Qwen/Qwen3.8-27B for fast inference on NVIDIA Blackwell (sm120) with vLLM.
All-time downloads
652
Public
Parameters
27.4B
55.8 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors27.7 GB · 100%
Parameter types
How the weights are stored.
U818.8B · 69%
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.8-27B-NVFP4
NVFP4 (4-bit, compressed-tensors nvfp4-pack-quantized) weight quantization of
Qwen/Qwen3.8-27B for fast inference on
NVIDIA Blackwell (sm_120) with vLLM.
Details
- Base model: Qwen/Qwen3.8-27B. Dense 27B, native vision-language, Gated-DeltaNet hybrid with MTP.
- Method: weight-only NVFP4, group size 16 (
compressed-tensors). - Target runtime: vLLM on Blackwell-class GPUs.
- Relation to base: quantization only. No weights were trained or fine-tuned.
Usage
vllm serve Preyazz/Qwen3.8-27B-NVFP4 --trust-remote-code
Provenance and license
This repository redistributes a quantized copy of Qwen/Qwen3.8-27B. All model
capabilities, credit, and the governing license belong to the Qwen team, and the base
model's license applies to this quantized derivative. See the original model card for
full model documentation, intended use, and limitations.
Provided as-is, without warranty.
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- qwen3_5
- License
- apache-2.0
- Created
- Aug 14, 2026
- Updated
- Aug 14, 2026