Skip to content

V-Bharath-raj

qwen2.5-0.5b-int8-quanto

V-Bharath-raj/qwen2.5-0.5b-int8-quanto

qwen2.5-0.5b-int8-quanto is a machine learning model from V-Bharath-raj. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

This repository contains an INT8 quantized version of the Qwen2.5-0.5B-Instruct model using Optimum Quanto. The model is optimized for reduced memory usage and improved inference efficiency while maintaining good gene…

Downloads · 30 days

4

9% of all-time downloads

All-time downloads

44

Public

Parameters

631M

779 MB on disk

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors767 MB · 99%

Parameter types

How the weights are stored.

I8494M · 78%

Type
qwen2
Created
Jun 21, 2026
Updated
Jun 21, 2026