Downloads · 30 days
49
37% of all-time downloads
Lucy-4B-it-qat-Q4_K_M
Xenna/Lucy-4B-it-qat-Q4_K_M
Lucy-4B-it-qat-Q4_K_M is a machine learning model from Xenna. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
Lucy 4B instruction-tuned model quantized with QAT (Quantization-Aware Training).
All-time downloads
131
Public
Repo size
5.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf5.9 GB · 100%
At a glance
- Access
- Public
- Created
- Sep 20, 2026
- Updated
- Sep 20, 2026
- SHA
- b208566b
Model card
From the Hugging Face model README
Lucy-4B-it-qat-Q4_K_M
Lucy 4B instruction-tuned model quantized with QAT (Quantization-Aware Training).
Files
Lucy-4B-it-qat-q4_0.i1-Q4_K_M.gguf— Main model weights (GGUF, Q4_K_M)Lucy-4B-it-qat-q4_0.mmproj-Q8_0.gguf— Multimodal projector (GGUF, Q8_0)
Model Details
| Parameter | Value |
|---|---|
| Architecture | Lucy |
| Parameters | 4B |
| Quantization | Q4_K_M (model) / Q8_0 (projector) |
| Training | Instruction-tuned with QAT |
Usage
Compatible with llama.cpp, GGUF-capable runtimes, and StelNet inference stack.
llama-cli -m Lucy-4B-it-qat-q4_0.i1-Q4_K_M.gguf -p "Hello!"
License
See upstream repository for licensing details.
- Created
- Sep 20, 2026
- Updated
- Sep 20, 2026