Downloads · 30 days
13
1% of all-time downloads
ChenMnZ/falcon-180b-omniquant-w3a16g512
falcon-180b-omniquant-w3a16g512 is a text generation model from ChenMnZ. Use it when you need the model to write or continue text. It is set up for transformers.
Downloads · 30 days
13
1% of all-time downloads
All-time downloads
2K
Public
Repo size
139 GB
Likes
3
Public
Click a slice to open those files.
.bin69.4 GB · 100%
From the Hugging Face model README
Paper: https://arxiv.org/abs/2308.13137
Code: https://github.com/OpenGVLab/OmniQuant
To run this model, refer https://github.com/OpenGVLab/OmniQuant/blob/main/runing_falcon180b_on_single_a100_80g.ipynb for more details.