Downloads · 30 days
119
11% of all-time downloads
qwen3.5-2b-shellcommand-linux-gguf
louisguthmann/qwen3.5-2b-shellcommand-linux-gguf
qwen3.5-2b-shellcommand-linux-gguf is a text generation model from louisguthmann. Use it when you need the model to write or continue text. It is set up for gguf.
This repository contains merged GGUF exports of the current best Qwen3.5-2B ShellCommand-Linux LoRA.
All-time downloads
1.1K
Public
Repo size
6.3 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf6.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- Access
- Public
- Created
- Mar 19, 2026
- Updated
- Mar 20, 2026
- SHA
- 72a4a56e
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen3.5-2B ShellCommand-Linux GGUF
This repository contains merged GGUF exports of the current best Qwen3.5-2B ShellCommand-Linux LoRA.
Source
- adapter source:
https://huggingface.co/louisguthmann/qwen3.5-2b-shellcommand-linux-lora - GitHub repo:
https://github.com/GuthL/bitnet-nl2sh
Files
Qwen3.5-2B-shellcommand-linux-F16.ggufQwen3.5-2B-shellcommand-linux-Q4_K_M.ggufQwen3.5-2B-shellcommand-linux-Q4_K_S.gguf
Inherited Eval Snapshot
These metrics come from the source LoRA adapter before GGUF quantization.
- score:
276.5033 - verifier ok rate:
0.7750 - verifier command rate:
0.7604 - verifier ask rate:
0.7500 - verifier cannot rate:
1.0000 - exact any-exact rate:
0.2500 - exact parse-ok rate:
0.9800
Recommended Deployment Variants
Q4_K_M: safer default if you want more quality headroomQ4_K_S: leaner option if memory or latency is tighter
CX23 Benchmarking
See the GitHub docs for the exact benchmark commands used for llama.cpp on Hetzner CX23.
- Task
- Text Generation
- Library
- gguf
- Created
- Mar 19, 2026
- Updated
- Mar 20, 2026