Downloads · 30 days
36
16% of all-time downloads
tiny-pickle-v3-coder-GGUF
vsan/tiny-pickle-v3-coder-GGUF
tiny-pickle-v3-coder-GGUF is a text generation model from vsan. Use it when you need the model to write or continue text. It is set up for llama.cpp. The card lists the license as apache-2.0.
Quantized GGUF releases of Tiny Pickle v3 Coder.
All-time downloads
229
Public
Repo size
51 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf51 GB · 100%
At a glance
- Task
- Text Generation
- Library
- llama.cpp
- License
- apache-2.0
- Access
- Public
- Created
- Aug 6, 2026
- Updated
- Aug 6, 2026
- SHA
- dd1d4b9d
Try a prompt
Base models
Model card
From the Hugging Face model README
Tiny Pickle v3 Coder — GGUF
Quantized GGUF releases of Tiny Pickle v3 Coder.
Tiny Pickle v3 Coder was produced by fine-tuning
Qwen/Qwen3-Coder-30B-A3B-Instruct with the LoRA adapter published at
vsan/tiny-pickle-v3-coder-LoRA, then merging and converting the resulting model with
llama.cpp.
Files
| File | Quantization | Approximate size |
|---|---|---|
tiny-pickle-v3-coder-q8_0.gguf | Q8_0 | 31G |
tiny-pickle-v3-coder-q4_k_m.gguf | Q4_K_M | 18G |
Q8_0 retains greater numerical fidelity but requires more storage and memory. Q4_K_M is smaller and more practical for local inference.
Run with llama.cpp
llama-cli \
-m tiny-pickle-v3-coder-q4_k_m.gguf \
-ngl 99 \
-c 8192 \
-p "Write a robust Python LRU cache with unit tests."
Intended use
- Code generation
- Debugging
- Code review
- Implementation planning
- Test generation
- Software-engineering assistance
Limitations
Tiny Pickle v3 Coder is experimental and has not yet been proven superior to its base model on independent benchmarks. Quantization may reduce model quality. Generated code can be incorrect, insecure, incomplete, or non-functional and must be reviewed and tested.
- Task
- Text Generation
- Library
- llama.cpp
- License
- apache-2.0
- Created
- Aug 6, 2026
- Updated
- Aug 6, 2026