Downloads · 30 days
3
6% of all-time downloads
Pantheon-10.7b-4bpw-exl2
Kooten/Pantheon-10.7b-4bpw-exl2
Pantheon-10.7b-4bpw-exl2 is a text generation model from Kooten. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
50
Public
Repo size
5.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.6 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jan 31, 2024
- Updated
- Jan 31, 2024
- SHA
- 4c02683a
Try a prompt
Model card
From the Hugging Face model README
Pantheon-10.7b 8bpw
Description
Exllama quant of Gryphe/Pantheon-10.7b
Other quants:
Prompt Format ChatML:
<|im_start|>system
You are Tiamat, a five-headed dragon goddess, embodying wickedness and cruelty.<|im_end|>
<|im_start|>user
Greetings, mighty Tiamat. I seek your guidance.<|im_end|>
<|im_start|>assistant
Contact
Kooten on discord
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jan 31, 2024
- Updated
- Jan 31, 2024