Downloads · 30 days
450
28% of all-time downloads
Qwen2.5-VL-7B-Instruct-FP8-Dynamic
ig1/Qwen2.5-VL-7B-Instruct-FP8-Dynamic
Qwen2.5-VL-7B-Instruct-FP8-Dynamic is a image-text-to-text model from ig1. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
1.6K
Public
Parameters
8.3B
10.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors10.1 GB · 100%
Parameter types
How the weights are stored.
F8_E4M36.5B · 79%
Try a prompt
Base models
Model card
From the Hugging Face model README
# Create a dedicated python env
python3 -m venv llmcompressor
source llmcompressor/bin/activate
# Install llm-compressor and additionnal needed libs
pip install llmcompressor qwen_vl_utils torchvision
# Download model in HF cache
hf download Qwen/Qwen2.5-VL-7B-Instruct
# Start quantization
wget https://github.com/vllm-project/llm-compressor/blob/main/examples/quantization_w8a8_fp8/qwen_2_5_vl_example.py -O qwen_2_5_vl_fp8.py
python3 qwen_2_5_vl_fp8.py
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- qwen2_5_vl
- License
- apache-2.0
- Languages
- en
- Created
- Feb 24, 2025
- Updated
- Oct 20, 2025