Downloads · 30 days
56
5% of all-time downloads
cobrakenji/granite-20b-code-base-GGUF
granite-20b-code-base-GGUF is a text generation model from cobrakenji. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is forked from IBM's granite-20b-code-base-GGUF - commit d70433a71e2fb9e20f8bfca3ff2d8c15393f0e44. Refer to the original model card for more details.
Downloads · 30 days
56
5% of all-time downloads
All-time downloads
1.2K
Public
Repo size
12.8 GB
Likes
0
Public
Click a slice to open those files.
.gguf12.8 GB · 100%
From the Hugging Face model README
This is forked from IBM's granite-20b-code-base-GGUF - commit d70433a71e2fb9e20f8bfca3ff2d8c15393f0e44.
Refer to the original model card for more details.
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
# install
make
# run generation
./main -m granite-20b-code-base-GGUF/granite-20b-code-base.Q4_K_M.gguf -n 128 -p "def generate_random(x: int):" --color