Downloads · 30 days
59
6% of all-time downloads
ristew/phi-2-imatrix-gguf
phi-2-imatrix-gguf is a machine learning model from ristew. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
phi-2 quantized using imatrix data from kalomaze's groupsmerged.txt
Downloads · 30 days
59
6% of all-time downloads
All-time downloads
1.1K
Public
Repo size
3.6 GB
Likes
1
Public
Click a slice to open those files.
.gguf3.6 GB · 100%
From the Hugging Face model README
phi-2 quantized using imatrix data from kalomaze's groups_merged.txt
Perplexities: Q8_0: 5.3886 Q4_0: 5.5526 IQ3_XXS: 6.0745 IQ2_XS: 7.2570 IQ2_XXS: 9.3666 IQ1_S: 18.7885