Skip to content

roshan-soni

qwen-3.5-0.8b-q4-k-m

roshan-soni/qwen-3.5-0.8b-q4-k-m

qwen-3.5-0.8b-q4-k-m is a machine learning model from roshan-soni. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as apache-2.0.

This repository contains a GGUF quantized version of Qwen3.5-0.8B optimized for local inference with llama.cpp and compatible applications.

Downloads · 30 days

0

Access

Public

Updated Jun 29, 2026

Repo size

542 MB

Likes

0

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.8b-q4-k-m542 MB · 100%

At a glance

Library
llama.cpp
License
apache-2.0
Access
Public
Created
Jun 29, 2026
Updated
Jun 29, 2026
SHA
f21c8c1f

Base models

Library
llama.cpp
License
apache-2.0
Languages
en, hi
Created
Jun 29, 2026
Updated
Jun 29, 2026