Downloads · 30 days
9
33% of all-time downloads
PygmalionAI/Pygmalion-3-12B-EXL2
Pygmalion-3-12B-EXL2 is a text generation model from PygmalionAI. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
This repo contains the ExLlamaV2 quants of the Pygmalion-3-12B model. The main branch only contains the measurement.json file, to produce your own quants of the model with a different bpw. You can find the pre-quanted…
Downloads · 30 days
9
33% of all-time downloads
All-time downloads
27
Public
Repo size
56.1 GB
Likes
1
Public
Click a slice to open those files.
.json2.2 MB · 100%
From the Hugging Face model README
This repo contains the ExLlamaV2 quants of the Pygmalion-3-12B model.
The main branch only contains the measurement.json file, to produce your own quants of the model with a different bpw.
You can find the pre-quanted checkpoints in the following branches: