Downloads · 30 days
7
2% of all-time downloads
saikanov/gemma2-9B-cpt-sahabatai-instruct-v1-Q4-K-M-GGUF
gemma2-9B-cpt-sahabatai-instruct-v1-Q4-K-M-GGUF is a machine learning model from saikanov. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as gemma.
This is a GGUF quantized version of Gemma 2 9B, fine-tuned with custom instructions by SahabatAI and optimized for CPU inference using Q4KM quantization.
Downloads · 30 days
7
2% of all-time downloads
All-time downloads
453
Public
Repo size
5.8 GB
Likes
0
Public
Click a slice to open those files.
.gguf5.8 GB · 100%
From the Hugging Face model README
This is a GGUF quantized version of Gemma 2 9B, fine-tuned with custom instructions by SahabatAI and optimized for CPU inference using Q4_K_M quantization.
This model is a quantized version of Gemma 2 9B, fine-tuned with custom instruction format by SahabatAI. The Q4_K_M quantization provides a good balance between model size, speed, and quality. The instruction format is optimized for general-purpose tasks while maintaining model coherence and reliability.
git clone https://github.com/oobabooga/text-generation-webui
cd text-generation-webui
run start-* depends on your OS
mkdir models
cd models
# Download gemma2-9B-cpt-sahabatai-instruct-v1-Q4_K_M.gguf from Hugging Face
temperature: 0.7
top_p: 0.9
top_k: 40
repetition_penalty: 1.1
max_new_tokens: 2048
<|system|>You are a helpful AI assistant.</|system|>
<|user|>What is the capital of Indonesia?</|user|>
<|assistant|>Jakarta is the capital city of Indonesia. It is located on the northwestern coast of Java, the most populous island in Indonesia. Jakarta serves as the country's economic, cultural, and political center.
<|user|>Write a simple Python function to calculate factorial.</|user|>
<|assistant|>Here's a simple recursive function to calculate factorial:
def factorial(n):
if n == 0 or n == 1:
return 1
return n * factorial(n-1)
This model is subject to the Gemma Terms of Use. Please refer to Google's Gemma licensing terms for commercial usage.
For issues and questions: