Downloads · 30 days
4
6% of all-time downloads
TeeZee/Xwin-LM-70B-V0.1_Limarpv3-bpw2.4-h6
Xwin-LM-70B-V0.1_Limarpv3-bpw2.4-h6 is a text generation model from TeeZee. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
exllamav2 quant for TeeZee/Xwin-LM-70B-V0.1Limarpv3
Downloads · 30 days
4
6% of all-time downloads
All-time downloads
66
Public
Repo size
21.3 GB
Likes
0
Public
Click a slice to open those files.
.safetensors21.3 GB · 100%
From the Hugging Face model README
exllamav2 quant for TeeZee/Xwin-LM-70B-V0.1_Limarpv3
Runs smoothly on single 3090 in webui with context length set to 4096, ExLlamav2_HF loader and cache_8bit=True
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: <a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>