Downloads · 30 days
3
9% of all-time downloads
topor4ik/qwen3vl-rukopys-band-dense-v1
qwen3vl-rukopys-band-dense-v1 is a image-text-to-text model from topor4ik. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
Language-only QLoRA adapter (vision tower frozen) that turns Qwen3-VL-8B-Instruct into a single-call detector + transcriber for Ukrainian handwritten document pages — one VLM call returns a JSON list of {bbox, type, t…
Downloads · 30 days
3
9% of all-time downloads
All-time downloads
35
Public
Repo size
186 MB
Likes
0
Public
Click a slice to open those files.
.safetensors175 MB · 92%
From the Hugging Face model README
Language-only QLoRA adapter (vision tower frozen) that turns Qwen3-VL-8B-Instruct into a single-call detector + transcriber for Ukrainian handwritten document pages — one VLM call returns a JSON list of {bbox, type, text} regions. Trained for the Kaggle Handwritten-to-Data competition on the RUKOPYS dataset.
Unmerged on purpose: serve it with vLLM --enable-lora on a shared Qwen/Qwen3-VL-8B-Instruct base — multiple adapter versions can run side-by-side on one base. The base weights are NOT in this repo; only the ~200 MB LoRA delta + adapter_config.json + processor (which are identical to the base under language-only LoRA).
unsloth/Qwen3-VL-8B-Instruct-unsloth-bnb-4bit (serve/merge on Qwen/Qwen3-VL-8B-Instruct)--enable-lora)python -m vllm.entrypoints.openai.api_server \
--model Qwen/Qwen3-VL-8B-Instruct \
--enable-lora --lora-modules qwen3vl-rukopys-band-dense-v1=topor4ik/qwen3vl-rukopys-band-dense-v1 \
--max-lora-rank 32 --max-model-len 16384
Then send chat-completions with model=<lora-module-name> and an image; the model returns {"regions": [{"bbox":[x1,y1,x2,y2], "type":"...", "text":"..."}]} with bbox in 0–1000 scale, top-to-bottom reading order.