Downloads · 30 days
2K
24% of all-time downloads
deepseek-coder-v2-lite-instruct-GGUF
mad-lab-ai/deepseek-coder-v2-lite-instruct-GGUF
deepseek-coder-v2-lite-instruct-GGUF is a machine learning model from mad-lab-ai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as other.
GGUF quantizations of DeepSeek-Coder-V2-Lite-Instruct with imatrix calibration for improved accuracy at lower bit depths.
All-time downloads
8.1K
Public
Repo size
36.3 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf36.3 GB · 100%
At a glance
- License
- other
- Access
- Public
- Created
- Apr 13, 2026
- Updated
- Apr 16, 2026
- SHA
- 83e0aab5
Base models
Model card
From the Hugging Face model README
DeepSeek-Coder-V2-Lite-Instruct-GGUF
GGUF quantizations of DeepSeek-Coder-V2-Lite-Instruct with imatrix calibration for improved accuracy at lower bit depths.
Available Quants
| Quant | Size | Use Case |
|---|---|---|
| Q6_K | ~13GB | Best quality, high VRAM |
| Q5_K_M | ~11GB | Recommended balance |
| Q4_K_M | ~9GB | Low VRAM / fast inference |
All quants use imatrix calibration data for better perplexity vs. standard quants.
Usage
Load with llama.cpp, Ollama, LM Studio, or any GGUF-compatible runtime.
Original Model
- License
- other
- Created
- Apr 13, 2026
- Updated
- Apr 16, 2026