Downloads · 30 days
27
6% of all-time downloads
Nous-Capybara-34B-iMat.GGUF
dranger003/Nous-Capybara-34B-iMat.GGUF
Nous-Capybara-34B-iMat.GGUF is a text generation model from dranger003. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as mit.
GGUF importance matrix (imatrix) quants for https://huggingface.co/NousResearch/Nous-Capybara-34B The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
All-time downloads
427
Public
Repo size
23 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf13.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- mit
- Access
- Public
- Created
- Feb 10, 2024
- Updated
- Feb 18, 2024
- SHA
- a93f4d8d
Try a prompt
Model card
From the Hugging Face model README
GGUF importance matrix (imatrix) quants for https://huggingface.co/NousResearch/Nous-Capybara-34B
The importance matrix was trained for 100K tokens (200 batches of 512 tokens) using wiki.train.raw.
Although this model is quite good, it is very sensitive with its prompt template - no space at end after ASSISTANT:
| Layers | Context | Template |
|---|---|---|
| <pre>60</pre> | <pre>200000</pre> | <pre>USER: {prompt}<br>ASSISTANT:{response}</pre> |
- Task
- Text Generation
- Library
- gguf
- License
- mit
- Created
- Feb 10, 2024
- Updated
- Feb 18, 2024