Downloads · 30 days
192
1% of all-time downloads
rob-x-ai/phi-2-GGUF
phi-2-GGUF is a text generation model from rob-x-ai. Use it when you need the model to write or continue text. The card lists the license as mit.
This is a quantized GGUF version of Microsoft Phi-2 to 40, 80 bits and the converted 16 FP model.
Downloads · 30 days
192
1% of all-time downloads
All-time downloads
14.5K
Public
Repo size
10.3 GB
Likes
22
Public
Click a slice to open those files.
.gguf10.3 GB · 100%
From the Hugging Face model README
This is a quantized GGUF version of Microsoft Phi-2 to 4_0, 8_0 bits and the converted 16 FP model.
(link to the original model : https://huggingface.co/microsoft/phi-2)
Disclamer : make sure to have the latest version of llama.cpp after commit b9e74f9bca5fdf7d0a22ed25e7a9626335fdfa48