Downloads · 30 days
24
10% of all-time downloads
TeeZee/BigMaid_20B_v1.0-bpw4.0-h6-exl2
BigMaid_20B_v1.0-bpw4.0-h6-exl2 is a text generation model from TeeZee. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
exllamav2 quant for TeeZee/BigMaid-20B-v1.0
Downloads · 30 days
24
10% of all-time downloads
All-time downloads
238
Public
Repo size
10.3 GB
Likes
4
Public
Click a slice to open those files.
.safetensors10.3 GB · 100%
From the Hugging Face model README
exllamav2 quant for TeeZee/BigMaid-20B-v1.0
Should run on 12 GB of VRAM cards in webui with context length set to 4096, ExLlamav2_HF loader and cache_8bit=True
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: <a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>