Downloads · 30 days
12
14% of all-time downloads
Chrisyichuan/qwen3vl-4b-wiki-screenshot-multik-2x-lora
qwen3vl-4b-wiki-screenshot-multik-2x-lora is a image-text-to-text model from Chrisyichuan. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
LoRA adapter for Qwen/Qwen3-VL-4B-Instruct, fine-tuned as the reader in a retrieval-augmented Wikipedia-screenshot QA pipeline.
Downloads · 30 days
12
14% of all-time downloads
All-time downloads
84
Public
Repo size
2.6 GB
Likes
0
Public
Click a slice to open those files.
.safetensors1.3 GB · 99%
From the Hugging Face model README
LoRA adapter for Qwen/Qwen3-VL-4B-Instruct, fine-tuned as the reader in a retrieval-augmented Wikipedia-screenshot QA pipeline.
Unlike the earlier fixed-3-image adapters, this v2 reads any number of screenshots from 1 to 6 at inference time, at a fixed 2x pixel compression per image.
| k (images per sample) | base Qwen3-VL-4B @ 0x (no compression, no SFT) | This adapter @ 2x | Δ |
|---|---|---|---|
| 1 | 0.958 | 0.946 | -0.012 |
| 2 | 0.912 | 0.950 | +0.038 |
| 3 | 0.892 | 0.954 | +0.062 |
| 4 | 0.856 | 0.936 | +0.080 |
Base@0x degrades sharply as the number of images grows (distractor confusion: 0.958 → 0.856 from k=1 to k=4). The 2x adapter is nearly k-invariant: 0.946 → 0.936 from k=1 to k=4 — only 0.010 drop.
At 2x compression, this adapter exceeds the uncompressed no-SFT baseline at k≥2 and nearly matches it at k=1 (0.946 vs 0.958), demonstrating that reader SFT fully compensates for both 2x compression and multi-image distractor confusion.
freeze_vision_tower=false)Qwen/Qwen3-VL-4B-Instructcutoff_len: 10240 (scaled per compression — larger for smaller compression where each image takes more tokens)Built from the Chrisyichuan/screenshot-training-natural-filtered-v2 QA dataset (~104k train examples):
1/sqrt(2) via PIL LANCZOS).<image>×k \n {query} → gold answer.Distribution: ~17k train samples per k value (uniform). eval/test sets likewise stratified over k∈{1..6}.
Gold-retrieval rate at top-6 across splits: ~75%. When gold is present at rank 1..6 among the retrieved hits, composition uses only retrieval results (else gold is always still included by construction).
from transformers import AutoProcessor, Qwen3VLForConditionalGeneration
from peft import PeftModel
import torch
base = "Qwen/Qwen3-VL-4B-Instruct"
adapter = "Chrisyichuan/qwen3vl-4b-wiki-screenshot-multik-2x-lora"
model = Qwen3VLForConditionalGeneration.from_pretrained(base, torch_dtype=torch.bfloat16).cuda()
model = PeftModel.from_pretrained(model, adapter).merge_and_unload()
processor = AutoProcessor.from_pretrained(base)
# k can be any integer in 1..6. Images must already be 2x-compressed.
messages = [{"role": "user", "content": [
{"type": "image", "image": img_1},
# ... up to img_6 ...
{"type": "text", "text": your_question},
]}]
# ... standard Qwen3-VL inference
Chrisyichuan/qwen3vl-4b-wiki-screenshot-multik-3x-lora, Chrisyichuan/qwen3vl-4b-wiki-screenshot-multik-4x-lora.