Downloads · 30 days
395
3% of all-time downloads
Nanbeige4.2-3B-heretic-GGUF
WaveCut/Nanbeige4.2-3B-heretic-GGUF
Nanbeige4.2-3B-heretic-GGUF is a text generation model from WaveCut. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Selected 4-bit-and-up GGUF quantizations of WaveCut/Nanbeige4.2-3B-heretic.
All-time downloads
12.9K
Public
Repo size
13.4 GB
Likes
15
Public
Repo makeup
Click a slice to open those files.
.gguf13.4 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Jul 22, 2026
- Updated
- Jul 23, 2026
- SHA
- 6baabe75
Try a prompt
Base models
Model card
From the Hugging Face model README
Nanbeige4.2-3B Heretic GGUF
Selected 4-bit-and-up GGUF quantizations of
WaveCut/Nanbeige4.2-3B-heretic.
| File | Role |
|---|---|
Nanbeige4.2-3B-heretic-Q4_K_M.gguf | Recommended compact mixed-precision default |
Nanbeige4.2-3B-heretic-Q5_K_M.gguf | Recommended quality/speed balance |
Nanbeige4.2-3B-heretic-Q6_K.gguf | High-quality K-quant |
Nanbeige4.2-3B-heretic-Q8_0.gguf | Near-lossless quality anchor |
No legacy Q4_0, Q5_0, or redundant same-bit variants are included.
The K-quants were calibrated with an importance matrix built from a deterministically shuffled agentic/coding corpus. Sources and revisions:
TIGER-Lab/SWE-QA-Pro-SFT-Trajectoriesatb8f5b8a8dcf90bca8b6d70adedac0d20dca02b86.nvidia/OpenCodeReasoningat20a1ca19c0d050fe9057fc08339d6b370ec1c67a.
Corpus SHA-256: a7cfdbe02c124304bf1282bbd5ed7162bfa72dec6750b60ed2d3a68000c7a554.
The imatrix input takes 256 evenly spaced corpus records, truncates each to
1,024 tokens, and processes 256 context-1,024 input chunks with special-token
parsing. Nanbeige's two execution loops produce 512 internal imatrix passes.
The derived text SHA-256 is
de99993785d460f0c48a8c35d36b764ef217ee227d6354cbeae0dc2cb155a30e.
Compatibility
Nanbeige 4.2 is a looped Transformer: 22 physical layers are executed twice.
These files were converted and validated with Nanbeige's llama.cpp branch at
revision 26cfdc4409cfc67d27be9b71c9de79adaf5f306f. Use that revision or a newer
llama.cpp build containing equivalent Nanbeige support.
./llama-cli \
-m Nanbeige4.2-3B-heretic-Q5_K_M.gguf \
-cnv -p "Write a robust retry helper in Python."
Exact file sizes, SHA-256 hashes, imatrix settings, and smoke-test throughput
are recorded in release-manifest.json.
- Task
- Text Generation
- License
- apache-2.0
- Created
- Jul 22, 2026
- Updated
- Jul 23, 2026