Downloads · 30 days
43
17% of all-time downloads
Qalb-1.0-8B-Instruct-Q4_0
mahwizzzz/Qalb-1.0-8B-Instruct-Q4_0
Qalb-1.0-8B-Instruct-Q4_0 is a machine learning model from mahwizzzz. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
This is a 4-bit quantized (Q40) GGUF version of enstazao/Qalb-1.0-8B-Instruct.
All-time downloads
249
Public
Repo size
4.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf4.7 GB · 100%
At a glance
- Library
- transformers
- License
- apache-2.0
- Access
- Public
- Created
- Feb 6, 2026
- Updated
- Feb 6, 2026
- SHA
- ffa7c3ed
Base models
Model card
From the Hugging Face model README
Qalb-1.0-8B-Instruct – Q4_0 GGUF
This is a 4-bit quantized (Q4_0) GGUF version of enstazao/Qalb-1.0-8B-Instruct.
Q4_0 is a fast and compact quantization format with acceptable quality degradation — good balance for local inference on consumer hardware.
Quick start (llama.cpp)
./llama-cli -m Qalb-1.0-8B-Instruct-Q4_0.gguf -ngl 35 -c 8192 --color -cnv -p "سلام! کیسے مدد کر سکتا ہوں؟"
Recommended inference settings
| Setting | Value | Comment |
|---|---|---|
| Quantization | Q4_0 | Fast, ~4.5 GB VRAM / RAM |
| GPU layers (-ngl) | 30–50 | Adjust according to your GPU VRAM |
| Context size (-c) | 4096–8192 | Depends on use-case |
| Temperature | 0.7–0.9 | Higher = more creative |
| Repeat penalty | 1.1–1.15 | Helps reduce repetition |
Performance (approximate – RTX 4060 8 GB)
- ~45–70 tokens/s at 4k context with good GPU offloading
- Quality close to original model for most everyday tasks
Original model
Thank you to the original creators.
Use responsibly.
- Library
- transformers
- License
- apache-2.0
- Languages
- ur, en
- Created
- Feb 6, 2026
- Updated
- Feb 6, 2026