Downloads · 30 days
12
5% of all-time downloads
TeeZee/2xNous-Capybara-34B-bpw3-h6-exl2
2xNous-Capybara-34B-bpw3-h6-exl2 is a text generation model from TeeZee. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
exllamav2 quant for TeeZee/2xNous-Capybara-34B
Downloads · 30 days
12
5% of all-time downloads
All-time downloads
233
Public
Repo size
22.2 GB
Likes
0
Public
Click a slice to open those files.
.safetensors22.2 GB · 100%
From the Hugging Face model README
exllamav2 quant for TeeZee/2xNous-Capybara-34B
Runs smoothly on single 3090 in webui with context length set to 4096, ExLlamav2_HF loader and cache_8bit=True
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: <a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>