Downloads · 30 days
10
14% of all-time downloads
imi2/TMAC-Llama-2-7b-EfficientQAT-w2g64
TMAC-Llama-2-7b-EfficientQAT-w2g64 is a machine learning model from imi2. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
the speed is not identical to other quantizations due to the two large layers kept in f16.
Downloads · 30 days
10
14% of all-time downloads
All-time downloads
69
Public
Repo size
2.8 GB
Likes
0
Public
Click a slice to open those files.
.gguf2.8 GB · 100%
From the Hugging Face model README
the speed is not identical to other quantizations due to the two large layers kept in f16.