Downloads · 30 days
31
4% of all-time downloads
Gamunu-4B-Instruct-Alpha-GGUF
manthilaffs/Gamunu-4B-Instruct-Alpha-GGUF
Gamunu-4B-Instruct-Alpha-GGUF is a text generation model from manthilaffs. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
These models was converted to GGUF format from manthilaffs/Gamunu-4B-Instruct-Alpha using llama.cpp. Refer to the original model card for more details on the model.
All-time downloads
855
Public
Repo size
11.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf11.9 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Nov 1, 2025
- Updated
- Nov 4, 2025
- SHA
- f3c439cb
Base models
Model card
From the Hugging Face model README
manthilaffs/Gamunu-4B-Instruct-Alpha-GGUF
These models was converted to GGUF format from manthilaffs/Gamunu-4B-Instruct-Alpha using llama.cpp.
Refer to the original model card for more details on the model.
Use with llama.cpp
Install llama.cpp through brew (works on Mac and Linux)
brew install llama.cpp
Invoke the llama.cpp server or the CLI.
CLI:
llama-cli --hf-repo manthilaffs/Gamunu-4B-Instruct-Alpha-GGUF --hf-file gamunu-4b-instruct-alpha-BF16.gguf -p "Hello! how are you?"
llama-cli --hf-repo manthilaffs/Gamunu-4B-Instruct-Alpha-GGUF --hf-file gamunu-4b-instruct-alpha-q8_0.gguf -p "Hello! how are you?"
Server:
llama-server --hf-repo manthilaffs/Gamunu-4B-Instruct-Alpha-GGUF --hf-file gamunu-4b-instruct-alpha-BF16.gguf -c 2048
llama-server --hf-repo manthilaffs/Gamunu-4B-Instruct-Alpha-GGUF --hf-file gamunu-4b-instruct-alpha-q8_0.gguf -c 2048
- Task
- Text Generation
- License
- apache-2.0
- Languages
- si, en
- Created
- Nov 1, 2025
- Updated
- Nov 4, 2025