Downloads · 30 days
5
0% of all-time downloads
InferenceIllusionist/psyonic-cetacean-20B-iMat-GGUF
psyonic-cetacean-20B-iMat-GGUF is a machine learning model from InferenceIllusionist. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
<img src="https://i.imgur.com/P68dXux.png" width="400"/
Downloads · 30 days
5
0% of all-time downloads
All-time downloads
1.3K
Public
Repo size
57.6 GB
Likes
2
Public
Click a slice to open those files.
.gguf57.6 GB · 100%
From the Hugging Face model README
psyonic-cetacean-20B quantized using importance matrix (with love).
Uploading some of the newer quants by request, starting with IQ3.
For more information on the latest importance matrix quants and how they stack up to legacy quantization methods please check out this PR.
<b>Need a different quantization/model? Please open a community post and I'll get back to you - thanks </b>