Downloads · 30 days
41
6% of all-time downloads
phi-4-GGUF-imatrix
mcm07/phi-4-GGUF-imatrix
phi-4-GGUF-imatrix is a machine learning model from mcm07. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Imatrix and quantizations created from https://huggingface.co/unsloth/phi-4-GGUF/phi-4-F16.gguf
All-time downloads
663
Public
Repo size
52.7 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf52.7 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Feb 3, 2025
- Updated
- Feb 3, 2025
- SHA
- 9545aa59
Base models
Model card
From the Hugging Face model README
llama.cpp and ik_llama.cpp imatrix Quantizations of unsloth/phi-4-GGUF
Imatrix and quantizations created from https://huggingface.co/unsloth/phi-4-GGUF/phi-4-F16.gguf
Imatrix dataset from bartowski1182
llama.cpp quants
phi-4-IQ2_S.gguf
phi-4-IQ3_XS.gguf
phi-4-Q4_K_M.gguf
phi-4-IQ4_XS.gguf
phi-4-IQ4_NL.gguf
ik_llama.cpp new quants
phi-4-IQ4_KS.gguf
phi-4-IQ4_NL_R4.gguf
Credits
llama.cpp, ik_llama.cpp, bartowski, microsoft, unsloth, huggingface
- License
- mit
- Languages
- en
- Created
- Feb 3, 2025
- Updated
- Feb 3, 2025