Downloads · 30 days
7
13% of all-time downloads
BigMaid_20B_v1.0-bpw3.0-h6-exl2
TeeZee/BigMaid_20B_v1.0-bpw3.0-h6-exl2
BigMaid_20B_v1.0-bpw3.0-h6-exl2 is a text generation model from TeeZee. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
exllamav2 quant for TeeZee/BigMaid-20B-v1.0
All-time downloads
52
Public
Repo size
7.8 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors7.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Mar 2, 2024
- Updated
- Mar 2, 2024
- SHA
- 3b695a38
Try a prompt
Model card
From the Hugging Face model README
BigMaid-20B-v1.0
exllamav2 quant for TeeZee/BigMaid-20B-v1.0
Should run on 12 GB of VRAM cards in webui with context length set to 4096, ExLlamav2_HF loader and cache_8bit=True
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: <a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Created
- Mar 2, 2024
- Updated
- Mar 2, 2024