Downloads · 30 days
4
4% of all-time downloads
yw223/Gemma-2-9B-it-AQLM-3bit
Gemma-2-9B-it-AQLM-3bit is a text generation model from yw223. Use it when you need the model to write or continue text. It is set up for transformers.
This repository contains a 3-bit AQLM quantized checkpoint derived from google/gemma-2-9b-it.
Downloads · 30 days
4
4% of all-time downloads
All-time downloads
109
Public
Repo size
10 GB
Likes
0
Public
Click a slice to open those files.
.bin5 GB · 99%
From the Hugging Face model README
This repository contains a 3-bit AQLM quantized checkpoint derived from google/gemma-2-9b-it.
The model was produced with the project AQLM workflow and converted to Hugging Face format.