Downloads · 30 days
242
8% of all-time downloads
jamesburton/Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-GGUF
Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw-GGUF is a machine learning model from jamesburton. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
This is a GGUF version of https://huggingface.co/PhilipMay/Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw
Downloads · 30 days
242
8% of all-time downloads
All-time downloads
3K
Public
Repo size
177 GB
Likes
0
Public
Click a slice to open those files.
.gguf177 GB · 100%
From the Hugging Face model README
This is a GGUF version of https://huggingface.co/PhilipMay/Phi-3-mini-4k-instruct-LLaMAfied-8xMoE-raw
The source model is an 8x MoE version of microsoft/Phi-3-mini-4k-instruct. It is based on the Llamafied version vonjack/Phi-3-mini-4k-instruct-LLaMAfied of Gan Feng.
It was created with the help of mergekit.
I have included the gguf-imat.py script and imatrix\imatrix.txt configuration used for the conversion. This is based on FantasiaFoundry/GGUF-Quantization-Script, and tweaked to pad vocab to allow operation with this model.
This model has been tested to be functional with LlamaSharp, so should be compatible with any llama.cpp based solutions.