Downloads · 30 days
475
87% of all-time downloads
Jeethu/Ornith-1.5-9B-PARO
Ornith-1.5-9B-PARO is a text generation model from Jeethu. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
Pairwise Rotation Quantization for Efficient Reasoning LLM Inference
Downloads · 30 days
475
87% of all-time downloads
All-time downloads
544
Public
Parameters
3.7B
9.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors9.1 GB · 100%
How the weights are stored.
F162.6B · 69%
From the Hugging Face model README
Pairwise Rotation Quantization for Efficient Reasoning LLM Inference
<p> <a href="https://arxiv.org/abs/2511.10645"><img src="https://img.shields.io/badge/arXiv-2511.10645-b31b1b.svg" alt="Paper"></a> <a href="https://paroquant.z-lab.ai"><img src="https://img.shields.io/badge/Blog-ParoQuant-blue" alt="Blog"></a> <a href="https://huggingface.co/collections/z-lab/paroquant"><img src="https://img.shields.io/badge/%F0%9F%A4%97-Models-yellow" alt="Models"></a> <a href="https://pypi.org/project/paroquant/"><img src="https://img.shields.io/pypi/v/paroquant" alt="PyPI"></a> </p>ParoQuant is the state-of-the-art INT4 quantization for LLMs. It closes the accuracy gap with FP16 while running at near-AWQ speed. Supports NVIDIA GPUs (vLLM, Transformers) and Apple Silicon (MLX). For more information, see https://github.com/z-lab/paroquant.
Jeethu/Ornith-1.5-9B-PARO is a 4-bit Jeethu/Ornith-1.5-9B-PARO quantized with ParoQuant.