Downloads · 30 days
84
38% of all-time downloads
zee713/zer-qwen-lite-gguf
zer-qwen-lite-gguf is a text generation model from zee713. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
The fine-tuned Zer model: a Qwen2.5-1.5B-Instruct base, QLoRA fine-tuned on short Amharic conversation/instruction pairs, merged and quantized to q4km for CPU deployment inside the ሕሳር (happi) NLP chatbot.
Downloads · 30 days
84
38% of all-time downloads
All-time downloads
221
Public
Repo size
986 MB
Likes
0
Public
Click a slice to open those files.
.gguf986 MB · 100%
From the Hugging Face model README
The fine-tuned Zer model: a Qwen2.5-1.5B-Instruct base,
QLoRA fine-tuned on short Amharic conversation/instruction pairs,
merged and quantized to q4_k_m for CPU deployment inside the
ሕሳር (happi) NLP chatbot.
Uploaded by the app's build tooling. Run on CPU with llama.cpp
(llama-cpp-python) — load time ~1s, gen ~40-60 tok/s.