Downloads · 30 days
22
12% of all-time downloads
Phi-4-mini-instruct-GGUF-Q3_K_M
harisnaeem/Phi-4-mini-instruct-GGUF-Q3_K_M
Phi-4-mini-instruct-GGUF-Q3_K_M is a machine learning model from harisnaeem. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This is a 3-bit quantized GGUF of Microsoft's Phi-4-mini-instruct 3.8B parameters Small Language Model.
All-time downloads
191
Public
Repo size
2.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf2.1 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Mar 9, 2025
- Updated
- Mar 11, 2025
- SHA
- da540480
Model card
From the Hugging Face model README
Phi-4-mini-instruct-GGUF-Q3_K_M
This is a 3-bit quantized GGUF of Microsoft's Phi-4-mini-instruct 3.8B parameters Small Language Model.
Description
The weights are quantized with llama.cpp to a 3-bit quantization (Q3_K_M). The Screen capture below shows the simple CLI interface, which runs in Linux Terminal locally on a computer with Intel CORE i5 CPU without internet.
Executing GGUF
- Simply download the "Phi-4-mini-instruct-GGUF-Q3_K_M.gguf" file or clone the repository
git clone https://huggingface.co/harisnaeem/Phi-4-mini-instruct-GGUF-Q3_K_M
- To run this Language Model in a simple CLI interface, provide the directory path to "llama-cli" and "Phi-4-mini-instruct-GGUF-Q3_K_M.gguf" in the Terminal.
(Path to llama CLI)/llama.cpp/build/bin/llama-cli --color --conversation --model (Path to model GGUF file)/Phi-4-mini-instruct-GGUF-Q3_K_M.gguf
Example
- License
- mit
- Created
- Mar 9, 2025
- Updated
- Mar 11, 2025