Downloads · 30 days
39
26% of all-time downloads
Nanbeige4.2-3B-Q4_K_M
mackkkkkilllll/Nanbeige4.2-3B-Q4_K_M
Nanbeige4.2-3B-Q4_K_M is a machine learning model from mackkkkkilllll. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp.
Q4KM GGUF quantization of Nanbeige/Nanbeige4.2-3B.
All-time downloads
149
Public
Repo size
2.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf2.6 GB · 100%
At a glance
- Library
- llama.cpp
- Access
- Public
- Created
- Aug 19, 2026
- Updated
- Aug 19, 2026
- SHA
- c2546246
Base models
Model card
From the Hugging Face model README
Nanbeige4.2-3B-Q4_K_M
Q4_K_M GGUF quantization of Nanbeige/Nanbeige4.2-3B.
Details
- Architecture: nanbeige
- Format: GGUF
- Quantization: Q4_K_M
- Effective BPW: 4.93
- Original size: 7953.53 MiB
- Quantized size: 2451.74 MiB
- Runtime: llama.cpp
Usage
Requires a recent llama.cpp version with nanbeige support.
llama-cli -m Nanbeige4.2-3B-Q4_K_M.gguf -ngl 99
Evaluation
Wikitext-2:
- Perplexity: 26.8796 ± 0.2620
- Context: 512
- Batch size: 512
- GPU offload: 99 layers
Base Model
Nanbeige/Nanbeige4.2-3B
No additional training or fine-tuning was performed.
- Library
- llama.cpp
- Created
- Aug 19, 2026
- Updated
- Aug 19, 2026