Downloads · 30 days
93
9% of all-time downloads
psgokulkrishnan/phi-4-mini-instruct-GGUF
phi-4-mini-instruct-GGUF is a text generation model from psgokulkrishnan. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
https://huggingface.co/microsoft/Phi-4-mini-instruct
Downloads · 30 days
93
9% of all-time downloads
All-time downloads
980
Public
Repo size
20.2 GB
Likes
0
Public
Click a slice to open those files.
.gguf20.2 GB · 100%
From the Hugging Face model README
https://huggingface.co/microsoft/Phi-4-mini-instruct
Usage: from llama_cpp import Llama
GGUF_PATH = "./phi_4_mini_instruct_Q4_K_M.gguf"
print("⏳ Initializing long-context GGUF engine directly into memory layout...")
llm = Llama(
model_path=GGUF_PATH,
n_ctx=16384,
flash_attn=True,
n_threads=4,
verbose=False
)