Downloads · 30 days
7
21% of all-time downloads
TeeZee/2xbagel-dpo-34b-v0.2-bpw2.8-h6-exl2
2xbagel-dpo-34b-v0.2-bpw2.8-h6-exl2 is a machine learning model from TeeZee. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
exllamav2 quant for TeeZee/2xbagel-dpo-34b-v0.2
Downloads · 30 days
7
21% of all-time downloads
All-time downloads
33
Public
Repo size
20.8 GB
Likes
0
Public
Click a slice to open those files.
.safetensors20.8 GB · 100%
From the Hugging Face model README
exllamav2 quant for TeeZee/2xbagel-dpo-34b-v0.2
Runs smoothly on single 3090 in webui with context length set to 4096, ExLlamav2_HF loader and cache_8bit=True
All comments are greatly appreciated, download, test and if you appreciate my work, consider buying me my fuel: <a href="https://www.buymeacoffee.com/TeeZee" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>