qwen2.5-vl-3b-crispembed-GGUF

<!-- crispembed-license-notice -->

License: Qwen RESEARCH LICENSE AGREEMENT — non-commercial use only. These files are conversions of Qwen/Qwen2.5-VL-3B-Instruct, which Alibaba Cloud releases under the Qwen Research License (LICENSE, verbatim; commercial use needs a license from Alibaba Cloud). An earlier version of this card said apache-2.0; that was incorrect. Built with Qwen. CrispEmbed loads them only with CRISPEMBED_ACCEPT_QWEN_RESEARCH_LICENSE=1. Evidence: license audit.

<!-- /crispembed-license-notice -->

Qwen2.5-VL-3B — GGUF (CrispEmbed)

GGUF conversion of Qwen/Qwen2.5-VL-3B-Instruct for the CrispEmbed qwen2vl-ocr backend.

3B vision-language model used primarily for document OCR and visual question answering. Processes images at dynamic resolution with a ViT encoder and generates text with a Qwen2.5 LLM decoder.

Architecture

• Vision encoder (ViT): 32 layers (1280-dim, 16 heads, patch_size=14), windowed attention (window=112) with full attention at layers {7, 15, 23, 31}, SwiGLU FFN, mRoPE
• Spatial merger: 4:1 merge to 2048-dim
• LLM decoder: 36-layer Qwen2.5 (2048-dim, GQA, mRoPE), up to 32K context
• Input: image(s) + text prompt
• Output: autoregressive text (OCR transcripts, descriptions, answers)

Files

Usage

crispembed --backend qwen2vl-ocr -m qwen2.5-vl-3b-q4_k.gguf \
    --image document.png

License

Apache 2.0.

Credits

• Original model: Qwen / Alibaba
• GGUF conversion & runtime: CrispEmbed

Provenance and EU AI Act Art. 53 note

• Upstream model: Qwen/Qwen2.5-VL-3B-Instruct — published by Qwen.
• Upstream licence: apache-2.0. This repository redistributes under the same terms; it grants no rights the upstream licence does not.
• What was done here: format conversion and/or quantisation only (GGUF). No training, no fine-tuning, no merging, no distillation, no change to architecture, vocabulary or capability. Only the numeric representation of the upstream weights differs.
• Training data: documented — where it is documented at all — by the upstream provider; see the upstream model card. No training data was used, added or selected by this repository. No training-content summary was found on the upstream model card at the time of writing; that documentation gap is upstream's and is not filled here.
• Provider status: under Regulation (EU) 2024/1689 the upstream authors remain the provider of this model. Converting the serialisation format does not make this repository the provider of a new general-purpose AI model, and no such claim is made. Questions about training content, copyright policy or model capability belong upstream.