Downloads · 30 days
28
3% of all-time downloads
bigatuna/NousCoder-14B-GGUF
NousCoder-14B-GGUF is a machine learning model from bigatuna. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for llama.cpp. The card lists the license as apache-2.0.
GGUF quantizations of NousResearch/NousCoder-14B for use with llama.cpp, Ollama, LM Studio, and other GGUF-compatible inference engines.
Downloads · 30 days
28
3% of all-time downloads
All-time downloads
1.1K
Public
Repo size
23 GB
Likes
10
Public
Click a slice to open those files.
.gguf23 GB · 100%
From the Hugging Face model README
GGUF quantizations of NousResearch/NousCoder-14B for use with llama.cpp, Ollama, LM Studio, and other GGUF-compatible inference engines.
All credit goes to NousResearch for training and releasing the original NousCoder-14B model. This repo only provides quantized GGUF versions for easier local inference.
| Filename | Quant | Size | Description |
|---|---|---|---|
nouscoder-14b-q4_k_m.gguf | Q4_K_M | 8.4 GB | Good balance of quality and size |
nouscoder-14b-q3_k_m.gguf | Q3_K_M | 6.9 GB | Lower memory, good quality |
nouscoder-14b-q3_k_s.gguf | Q3_K_S | 6.2 GB | Smallest, for constrained environments |
./llama-cli -m nouscoder-14b-q4_k_m.gguf -p "def fibonacci(n):"
ollama run hf.co/bigatuna/NousCoder-14B-GGUF:Q4_K_M