Downloads · 30 days
80
29% of all-time downloads
tshaik1990/qwen3.5-2b-prompt-compiler-GGUF
qwen3.5-2b-prompt-compiler-GGUF is a text generation model from tshaik1990. Use it when you need the model to write or continue text.
Quantized GGUF build of a LoRA fine-tune of unsloth/Qwen3.5-2B, for use with Ollama or llama.cpp.
Downloads · 30 days
80
29% of all-time downloads
All-time downloads
277
Public
Repo size
2 GB
Likes
1
Public
Click a slice to open those files.
.gguf2 GB · 100%
From the Hugging Face model README
Quantized GGUF build of a LoRA fine-tune of unsloth/Qwen3.5-2B, for use with Ollama or llama.cpp.
The adapter (safetensors, for transformers/peft) is at tshaik1990/qwen3.5-2b-prompt-compiler.
| File | Quantization | Size |
|---|---|---|
Qwen3.5-2B.Q4_K_M.gguf | Q4_K_M | ~1.31 GB |
Qwen3.5-2B.F16-mmproj.gguf | F16 (vision projector) | ~668 MB |
SHA256 checksums are in SHA256SUMS.txt — verify with shasum -a 256 -c SHA256SUMS.txt.
Given a system prompt instructing it to act as a prompt compiler, it turns a short, underspecified request into a clear, structured, implementation-ready prompt — asking for missing context (budget, location, constraints, etc.) instead of inventing it, and staying in the "write a prompt" role instead of drifting into answering the request directly.
ollama run tshaik1990/qwen3.5-2b-prompt-compiler-GGUF
Or build locally from a downloaded GGUF with a Modelfile:
FROM ./Qwen3.5-2B.Q4_K_M.gguf
FROM ./Qwen3.5-2B.F16-mmproj.gguf
RENDERER qwen3.5
PARSER qwen3.5
SYSTEM """You are a prompt compiler. Convert the user's request into a clear, structured, implementation-ready prompt while preserving all stated requirements."""
PARAMETER temperature 0.2
PARAMETER top_p 0.95
PARAMETER top_k 20
PARAMETER num_ctx 4096
ollama create qwen3.5-2b-prompt-compiler -f Modelfile
ollama run qwen3.5-2b-prompt-compiler
Benchmarked against the unmodified base model under identical sampling settings (temperature 0.2, top_p 0.95, top_k 20, same system prompt) across 20 held-out prompts:
Trained for a single epoch on a small, self-authored dataset; the evaluation above is self-authored, not an independent benchmark, and human-preference review is still pending. Small (2B) model — may not generalize well outside prompt-compiling use cases.
Inherits the license of the base model, unsloth/Qwen3.5-2B.