Downloads · 30 days
17
15% of all-time downloads
grimulkan/Goliath-longLORA-120b-rope8-32k-6bpw_h8_exl2
Goliath-longLORA-120b-rope8-32k-6bpw_h8_exl2 is a text generation model from grimulkan. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
This is an EXL2 6-bit quantization of Goliath-longLORA-120b-rope8-32k-fp16
Downloads · 30 days
17
15% of all-time downloads
All-time downloads
114
Public
Repo size
88.8 GB
Likes
1
Public
Click a slice to open those files.
.safetensors88.8 GB · 100%
From the Hugging Face model README
This is an EXL2 6-bit quantization of Goliath-longLORA-120b-rope8-32k-fp16