Downloads · 30 days
4
7% of all-time downloads
TeeZee/DarkForest-20B-v2.0-bpw4.0-h6-exl2
DarkForest-20B-v2.0-bpw4.0-h6-exl2 is a text generation model from TeeZee. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as other.
exllamav2 quant for TeeZee/DarkForest-20B-v2.0
Downloads · 30 days
4
7% of all-time downloads
All-time downloads
57
Public
Repo size
10.3 GB
Likes
3
Public
Click a slice to open those files.
.safetensors10.3 GB · 100%
From the Hugging Face model README
exllamav2 quant for TeeZee/DarkForest-20B-v2.0
Runs smoothly on single 3090 in webui with context length set to 4096, ExLlamav2_HF loader and cache_8bit=True
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: <a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>