Downloads · 30 days
147
8% of all-time downloads
ThijsL202/CraneAILabs_swahili-gemma-1b-GGUF
CraneAILabs_swahili-gemma-1b-GGUF is a text generation model from ThijsL202. Use it when you need the model to write or continue text. It is set up for transformers.
- Base Model: CraneAILabs/swahili-gemma-1b - Quantization: Standard - Total Size: 4.03 GB (5 files)
Downloads · 30 days
147
8% of all-time downloads
All-time downloads
1.7K
Public
Repo size
4.3 GB
Likes
0
Public
Click a slice to open those files.
.gguf4.3 GB · 100%
From the Hugging Face model README
./llama-cli -m CraneAILabs_swahili-gemma-1b.Q6_K.gguf -p "Your prompt here" -n 512
from llama_cpp import Llama
llm = Llama(model_path="./CraneAILabs_swahili-gemma-1b.Q6_K.gguf", n_ctx=2048)
output = llm("Your prompt here", max_tokens=512)
print(output["choices"][0]["text"])
Original model: CraneAILabs/swahili-gemma-1b
Quantized using llama.cpp