Downloads · 30 days
0
vllm-wheel
LeTue09/vllm-wheel
vllm-wheel is a machine learning model from LeTue09. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This archive contains a Linux x8664 vLLM nightly wheel that supports the Qwen35ForConditionalGeneration architecture used by Qwen/Qwen3.5-4B.
Access
Public
Updated Jun 17, 2026
Repo size
272 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gz272 MB · 100%
At a glance
- Access
- Public
- Created
- Jun 17, 2026
- Updated
- Jun 17, 2026
- SHA
- bccd5edb
Model card
From the Hugging Face model README
vLLM Nightly Wheel for Qwen3.5
This archive contains a Linux x86_64 vLLM nightly wheel that supports the
Qwen3_5ForConditionalGeneration architecture used by Qwen/Qwen3.5-4B.
Install on the cluster
tar -xzf vllm-wheel-linux-x86_64.tar.gz
python -m pip install --no-index --no-deps --force-reinstall \
./vllm-0.23.1rc1.dev102+ga46abb7ae-cp38-abi3-manylinux_2_28_x86_64.whl
python -c "import vllm; print(vllm.__version__)"
Serve Qwen3.5
CUDA_VISIBLE_DEVICES=1,2 vllm serve /cm/archive/tue09/model_hub/Qwen/Qwen3.5-4B \
--port 8000 \
--served-model-name Qwen/Qwen3.5-4B \
--tensor-parallel-size 2 \
--max-model-len 8192 \
--reasoning-parser qwen3 \
--language-model-only
- Created
- Jun 17, 2026
- Updated
- Jun 17, 2026