Downloads · 30 days
143
1% of all-time downloads
gemma-2-9b-it-GGUF
gaianet/gemma-2-9b-it-GGUF
gemma-2-9b-it-GGUF is a text generation model from gaianet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as gemma.
All-time downloads
12.2K
Public
Repo size
90.2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf90.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- gemma
- Model type
- gemma2
- Access
- Public
- Created
- Jun 28, 2024
- Updated
- Jul 2, 2024
- SHA
- c705ab7d
Try a prompt
Base models
Model card
From the Hugging Face model README
Gemma-2-9b-it-GGUF
Original Model
Run with Gaianet
Prompt template:
prompt template: gemma-instruct
Context size:
- Max
chat_ctx_size: 8192
- Recommend
chat_ctx_size: 4096
Run with GaiaNet:
-
Quick start with Gemma-2-9b-it: https://github.com/GaiaNet-AI/node-configs/blob/main/gemma-2-9b-it/README.md
-
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b3259
- Task
- Text Generation
- Library
- transformers
- Type
- gemma2
- License
- gemma
- Created
- Jun 28, 2024
- Updated
- Jul 2, 2024