Downloads · 30 days
3
5% of all-time downloads
llmixer/BigWeave-v6-90b-4.0bpw-h8-exl2
BigWeave-v6-90b-4.0bpw-h8-exl2 is a text generation model from llmixer. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
Exllamav2 4.0bpw h8 quant for BigWeave-v6-90b.
Downloads · 30 days
3
5% of all-time downloads
All-time downloads
66
Public
Repo size
44.5 GB
Likes
0
Public
Click a slice to open those files.
.safetensors44.5 GB · 100%
From the Hugging Face model README
Exllamav2 4.0bpw h8 quant for BigWeave-v6-90b.
Calibration dataset: llmixer/20k_random_data
Fits 48GB VRAM with 4k context. Slightly lower ppl than Goliath-120b 3.0bpw.