Downloads · 30 days
18
18% of all-time downloads
InternVL3_5-2B_GPTQ_INT4
AXERA-TECH/InternVL3_5-2B_GPTQ_INT4
InternVL3_5-2B_GPTQ_INT4 is a image-text-to-text model from AXERA-TECH. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as bsd-3-clause.
InternVL3.5-2B (InternViT + Qwen3-1.7B) converted to run on the Axera NPU with w4a16 quantization, packaged in ax-llm model-directory format.
All-time downloads
101
Public
Repo size
4.8 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.axmodel1.7 GB · 73%
At a glance
- Task
- Image-Text-to-Text
- Library
- transformers
- License
- bsd-3-clause
- Access
- Public
- Created
- Dec 26, 2025
- Updated
- Aug 17, 2026
- SHA
- 876ac2cb
Try a prompt
Base models
Model card
From the Hugging Face model README
InternVL3_5-2B_GPTQ_INT4
InternVL3.5-2B (InternViT + Qwen3-1.7B) converted to run on the Axera NPU with w4a16 quantization, packaged in ax-llm model-directory format.
- Compatible with Pulsar2 5.1-patch1
- Context length: 2k, max prefill: 1k, image input: 448×448
- Target chip: AX650 (AX650N host & AXCL M.2 accelerator)
This repository is a ready-to-run ax-llm model directory:
.
├── config.json # ax-llm runtime config (vlm_type=InternVL3, tokenizer_type=InternVL3_5)
├── internvl3-5-2b_tokenizer.txt # tokenizer
├── post_config.json # sampling config
├── internvl3-5_axmodel/ # LLM: qwen3_p128_l0..l27 (28) + qwen3_post + embed
└── vit-models/ # InternViT image encoder (internvl_vit_model_1x3x448x448.axmodel)
Support Platform
- AX650
- AX650N DEMO Board
- M4N-Dock (爱芯派Pro)
- M.2 Accelerator card (AXCL)
| Chip | image encoder 448 | ttft | w4a16 |
|---|---|---|---|
| AX650 | 364.412 ms | 4951.50 ms | 28.07 tokens/sec |
How to use
Build/obtain the ax-llm runtime: AXera NPU LLM Runtime (ax-llm)
# interactive chat
./axllm run InternVL3_5-2B_GPTQ_INT4
# OpenAI-compatible HTTP server (default port 8000)
./axllm serve InternVL3_5-2B_GPTQ_INT4
On AXCL, choose the card via AXLLM_DEVICES=<id> or the "devices" field in config.json.
Source & conversion
- Base model: OpenGVLab/InternVL3_5-2B
- License: BSD-3-Clause
- Task
- Image-Text-to-Text
- Library
- transformers
- License
- bsd-3-clause
- Languages
- en
- Created
- Dec 26, 2025
- Updated
- Aug 17, 2026