Downloads · 30 days
328
2% of all-time downloads
gaianet/Gemma-2-9B-Chinese-Chat-GGUF
Gemma-2-9B-Chinese-Chat-GGUF is a text generation model from gaianet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as gemma.
Downloads · 30 days
328
2% of all-time downloads
All-time downloads
15.2K
Public
Repo size
90.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf90.2 GB · 100%
From the Hugging Face model README
shenzhi-wang/Gemma-2-9B-Chinese-Chat
Prompt template:
prompt template: gemma-instruct
Context size:
chat_ctx_size: 8192
Run with GaiaNet:
Quick start with Gemma-2-9b-it: https://github.com/GaiaNet-AI/node-configs/blob/main/gemma-2-9b-it/README.md
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b3259