Downloads · 30 days
18
16% of all-time downloads
humbleakh/qwen2.5-vl-3b-4bit-chain-of-zoom
qwen2.5-vl-3b-4bit-chain-of-zoom is a image-text-to-text model from humbleakh. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
4-bit quantized Vision-Language Model optimized for Chain-of-Zoom super-resolution
Downloads · 30 days
18
16% of all-time downloads
All-time downloads
114
Public
Parameters
3.8B
6.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors3 GB · 99%
How the weights are stored.
U83.1B · 81%
From the Hugging Face model README
4-bit quantized Vision-Language Model optimized for Chain-of-Zoom super-resolution
This model is part of the Chain-of-Zoom 4-bit Quantized Pipeline - a memory-optimized version of the original Chain-of-Zoom super-resolution framework.
# Install required packages
pip install transformers accelerate bitsandbytes torch
# Load quantized model
from transformers import BitsAndBytesConfig
import torch
# 4-bit quantization config
bnb_config = BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_use_double_quant=True,
bnb_4bit_compute_dtype=torch.bfloat16
)
# Model-specific loading code here
# (See complete notebook for detailed usage)
@misc{chain-of-zoom-4bit-vlm,
title={Chain-of-Zoom 4-bit Quantized Qwen2.5-VL-3B 4-bit Quantized for Chain-of-Zoom},
author={humbleakh},
year={2024},
publisher={Hugging Face},
url={https://huggingface.co/humbleakh/qwen2.5-vl-3b-4bit-chain-of-zoom}
}
Apache 2.0 - See original model licenses for specific components.