Downloads · 30 days
23
11% of all-time downloads
teja161615/Tejapriyan-8B-GGUF
Tejapriyan-8B-GGUF is a text generation model from teja161615. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Quantized GGUF weights of Tejapriyan-8B for ultra-fast local inference on CPU and GPU with Ollama, llama.cpp, and LM Studio. Fine-tuned and quantized by Teja Priyan.
Downloads · 30 days
23
11% of all-time downloads
All-time downloads
211
Public
Repo size
4.7 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.7 GB · 100%
From the Hugging Face model README
Quantized GGUF weights of Tejapriyan-8B for ultra-fast local inference on CPU and GPU with Ollama, llama.cpp, and LM Studio.
Fine-tuned and quantized by Teja Priyan.
| File Name | Quantization | Size | RAM / VRAM Required | Recommended For |
|---|---|---|---|---|
tejapriyan-q4_k_m.gguf | Q4_K_M (Medium) | ~4.7 GB | ~5.5 GB | Best balance of speed, size & quality (Recommended) |
tejapriyan-q8_0.gguf | Q8_0 (8-bit) | ~8.5 GB | ~9.2 GB | Near-lossless accuracy on high-spec systems |
tejapriyan-f16.gguf | F16 (Full Precision) | ~15.2 GB | ~16.5 GB | Full baseline fidelity |
# Download the GGUF file directly
curl -L -o tejapriyan-q4_k_m.gguf https://huggingface.co/teja161615/Tejapriyan-8B-GGUF/resolve/main/tejapriyan-q4_k_m.gguf