Downloads · 30 days
8
14% of all-time downloads
Qwen3.5-9B-PARO
Jeethu/Qwen3.5-9B-PARO
Qwen3.5-9B-PARO is a image-text-to-text model from Jeethu. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Pairwise Rotation Quantization for Efficient Reasoning LLM Inference
All-time downloads
59
Public
Parameters
3.7B
9.1 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors9.1 GB · 100%
Parameter types
How the weights are stored.
F162.6B · 69%
Try a prompt
Base models
Model card
From the Hugging Face model README
Jeethu/Qwen3.5-9B-PARO
Pairwise Rotation Quantization for Efficient Reasoning LLM Inference
<p> <a href="https://arxiv.org/abs/2511.10645"><img src="https://img.shields.io/badge/arXiv-2511.10645-b31b1b.svg" alt="Paper"></a> <a href="https://paroquant.z-lab.ai"><img src="https://img.shields.io/badge/Blog-ParoQuant-blue" alt="Blog"></a> <a href="https://huggingface.co/collections/z-lab/paroquant"><img src="https://img.shields.io/badge/%F0%9F%A4%97-Models-yellow" alt="Models"></a> <a href="https://pypi.org/project/paroquant/"><img src="https://img.shields.io/pypi/v/paroquant" alt="PyPI"></a> </p>ParoQuant is the state-of-the-art INT4 quantization for LLMs. It closes the accuracy gap with FP16 while running at near-AWQ speed. Supports NVIDIA GPUs (vLLM, Transformers) and Apple Silicon (MLX). For more information, see https://github.com/z-lab/paroquant.
Jeethu/Qwen3.5-9B-PARO is a 4-bit Qwen/Qwen3.5-9B quantized with ParoQuant.
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- qwen3_5
- License
- apache-2.0
- Created
- May 27, 2026
- Updated
- May 27, 2026