Downloads · 30 days
133
5% of all-time downloads
Kimi-K2.7-Code-GGUF
Chen2921/Kimi-K2.7-Code-GGUF
Kimi-K2.7-Code-GGUF is a machine learning model from Chen2921. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
- 06/15/2026: I've updated the Q3KL quant, it wasn't imatrixed (oops) and the new upload is. The PPL and KLD are slightly improved. Working on smaller quants still.
All-time downloads
2.6K
Public
Repo size
2.1 TB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf2.1 TB · 100%
At a glance
- Access
- Public
- Created
- Jun 21, 2026
- Updated
- Jun 21, 2026
- SHA
- 706fc230
Base models
Model card
From the Hugging Face model README
Updates
- 06/15/2026: I've updated the Q3_K_L quant, it wasn't imatrixed (oops) and the new upload is. The PPL and KLD are slightly improved. Working on smaller quants still.
Model
This is a text-and-image-only GGUF quantization of moonshotai/Kimi-K2.7-Code. This means that video input is not present in this GGUF, and will not be available until support is added upstream in llama.cpp. MMPROJ files for image vision input have been provided.
This Q4_X quant is the "full quality" equivalent since the conditional experts are natively INT4 quantized directly from the original model, and the rest of the model is Q8_0.
| Quant | Size | Mixture | PPL | 1-(Mean PPL(Q)/PPL(base)) | KLD |
|---|---|---|---|---|---|
| Q4_X | 543.62 GiB (4.55 BPW) | Q8_0 / Q4_0 / Q4_0 / Q4_0 | 2.009155 ± 0.008931 | +0% | 0 |
| Q3_K_L | 459.94 GiB (3.85 BPW) | Q8_0 / Q3_K / Q3_K / Q4_0 | 2.085207 ± 0.009398 | +3.9167% | 0.063007 ± 0.000544 |
| IQ3_S | 377.54 GiB (3.16 BPW) | Q8_0 / varies | 2.310321 ± 0.010823 | +15.1353% | 0.178673 ± 0.001326 |
| IQ2_S | 311.80 GiB (2.61 BPW) | Q8_0 / varies | 2.690751 ± 0.013248 | +34.0941% | 0.343187 ± 0.002100 |
| IQ2_XXS | 262.78 GiB (2.20 BPW) | Q8_0 / varies | 3.420305 ± 0.018189 | +70.4515% | 0.587342 ± 0.002980 |
The mixtures with varies in them were produced by @eaddario 's llama.cpp branches for imatrix and quantize respectively:
- imatrix: https://github.com/ggml-org/llama.cpp/pull/14891
- quantize: https://github.com/ggml-org/llama.cpp/pull/15550
- Created
- Jun 21, 2026
- Updated
- Jun 21, 2026