Downloads · 30 days
707
4% of all-time downloads
gaianet/Yi-1.5-9B-Chat-GGUF
Yi-1.5-9B-Chat-GGUF is a text generation model from gaianet. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<div style="width: auto; margin-left: auto; margin-right: auto" <img src="https://github.com/GaiaNet-AI/.github/assets/45785633/d6976adc-f97d-4f86-a648-0f2f5c8e7eee" style="width: 100%; min-width: 400px; display: bloc…
Downloads · 30 days
707
4% of all-time downloads
All-time downloads
16K
Public
Repo size
169 GB
Likes
2
Public
Click a slice to open those files.
.gguf84.5 GB · 100%
From the Hugging Face model README
Prompt template:
prompt template: chatml
Reverse prompt
reverse prompt: <|im_end|>
Context size:
chat_ctx_size: 4096
Run with GaiaNet:
Quick start: https://docs.gaianet.ai/node-guide/quick-start
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b3135