Downloads · 30 days
162
33% of all-time downloads
TaimoorSiddiqui/Hopcoder-Mini-9B-SWE-Agent-GGUF
Hopcoder-Mini-9B-SWE-Agent-GGUF is a machine learning model from TaimoorSiddiqui. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp.
GGUF quantized version of the Hopcoder-Mini-9B-SWE-Agent model.
Downloads · 30 days
162
33% of all-time downloads
All-time downloads
497
Public
Repo size
39.5 GB
Likes
0
Public
Click a slice to open those files.
.gguf39.5 GB · 100%
From the Hugging Face model README
GGUF quantized version of the Hopcoder-Mini-9B-SWE-Agent model.
| Quantization | File | Size |
|---|---|---|
| Q4_K_M | Hopcoder-Mini-9B-SWE-Agent-Q4_K_M.gguf | 5.63 GB |
| Q5_K_M | Hopcoder-Mini-9B-SWE-Agent-Q5_K_M.gguf | 6.47 GB |
| Q8_0 | Hopcoder-Mini-9B-SWE-Agent-Q8_0.gguf | 9.53 GB |
| F16 | Hopcoder-Mini-9B-SWE-Agent-F16.gguf | 17.92 GB |
# Download a quantized file
huggingface-cli download TaimoorSiddiqui/Hopcoder-Mini-9B-SWE-Agent-GGUF Hopcoder-Mini-9B-SWE-Agent-Q4_K_M.gguf --local-dir ./
# Run with llama.cpp
llama-server --model Hopcoder-Mini-9B-SWE-Agent-Q4_K_M.gguf --n-gpu-layers 99 --port 8080
The original PEFT/LoRA adapter is available at: