Downloads · 30 days
70
5% of all-time downloads
Qwen3-4B-GGUF
mobilint/Qwen3-4B-GGUF
Qwen3-4B-GGUF is a text generation model from mobilint. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
<p align="center" <a href="https://mobilint.com"<img src="https://huggingface.co/mobilint/Llama-3.1-8B-Instruct/resolve/main/mobilintlogo.png" width="400"/</a </p
All-time downloads
1.3K
Public
Repo size
5.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.mxq2.1 GB · 57%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Model type
- mobilint-qwen3
- Access
- Public
- Created
- Mar 26, 2026
- Updated
- Jun 29, 2026
- SHA
- 86f2e33b
Try a prompt
Base models
Model card
From the Hugging Face model README
<p align="center">
<a href="https://mobilint.com"><img src="https://huggingface.co/mobilint/Llama-3.1-8B-Instruct/resolve/main/mobilint_logo.png" width="400"/></a>
</p>
Qwen3 4B — GGUF + MXQ for llama-cli-mblt
This repository provides Qwen3 4B compiled and optimized for Mobilint NPU hardware, packaged for use with llama.cpp-mblt.
Quick Start
# Interactive chat
llama-cli-mblt -hf mobilint/Qwen3-4B-GGUF
# Single prompt
llama-simple-mblt -hf mobilint/Qwen3-4B-GGUF "Hello world"
Files
| File | Size | Description |
|---|---|---|
qwen3-4b-vocab.gguf | 5.7 MB | Tokenizer (vocab-only GGUF) |
target_emb.bin | 1.5 GB | Body embedding weights (float32) |
Qwen3-4B-W4V8.mxq | 2.1 GB | Body model for NPU (W4V8 quantized) |
config.json | — | Model configuration |
About
This model is compiled and optimized for Mobilint NPU hardware. It is intended to be used with llama-cli-mblt from llama.cpp-mblt.
- Task
- Text Generation
- Library
- gguf
- Type
- mobilint-qwen3
- License
- apache-2.0
- Created
- Mar 26, 2026
- Updated
- Jun 29, 2026