Downloads · 30 days
9
14% of all-time downloads
yw223/Gemma-2-9B-it-AQLM-4bit
Gemma-2-9B-it-AQLM-4bit is a text generation model from yw223. Use it when you need the model to write or continue text. It is set up for transformers.
This repository contains a 4-bit AQLM quantized checkpoint derived from google/gemma-2-9b-it.
Downloads · 30 days
9
14% of all-time downloads
All-time downloads
65
Public
Repo size
12.1 GB
Likes
0
Public
Click a slice to open those files.
.bin6 GB · 99%
From the Hugging Face model README
This repository contains a 4-bit AQLM quantized checkpoint derived from google/gemma-2-9b-it.
The model was produced with the project AQLM workflow and converted to Hugging Face format.