phi-2-super-GGUF

sayhan/phi-2-super-GGUF

phi-2-super-GGUF is a text generation model from sayhan. Use it when you need the model to write or continue text. The card lists the license as mit.

- Model creator: Anton Bacaj - Original model: Phi-2 Super

Downloads · 30 days

262

3% of all-time downloads

All-time downloads

8.2K

Public

Repo size

27 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf27 GB · 100%

At a glance

Task: Text Generation
License: mit
Access: Public
Created: Mar 1, 2024
Updated: Mar 1, 2024
SHA: 07e05ae2

Try a prompt

Model card

From the Hugging Face model README

Phi-2 Super (SFT + cDPO)

image/png

Model creator: Anton Bacaj
Original model: Phi-2 Super

Description

This repo contains GGUF format model files for abacaj's Phi-2 Super

Quantization types

Since the model is relatively very small, I recommend the larger quantizations.

quantization method	bits	description	recommended
Q2_K	2	smallest, significant quality loss	❌
Q3_K_S	3	very small, high quality loss	❌
Q3_K_M	3	very small, high quality loss	❌
Q3_K_L	3	small, substantial quality loss	❌
Q4_0	4	legacy; small, very high quality loss	❌
Q4_K_M	4	medium, balanced quality	❌
Q5_0	5	legacy; medium, balanced quality	❌
Q5_K_S	5	large, low quality loss	✅
Q5_K_M	5	large, very low quality loss	✅
Q6_K	6	very large, extremely low quality loss	❌
Q8_0	8	very large, extremely low quality loss	❌
FP16	16	enormous, negligible quality loss	❌

Phi-2-super (SFT + cDPO)

Base Model: microsoft/phi-2

Chat template

The model uses the same chat template as found in Mistral instruct models:

text = "<|endoftext|>[INST] What is your favourite condiment? [/INST]"
"Well, I'm quite partial to a good squeeze of fresh lemon juice. It adds just the right amount of zesty flavour to whatever I'm cooking up in the kitchen!<|endoftext|> "
"[INST] Do you have mayonnaise recipes? [/INST]"

MT-bench / heval

image/png

Task: Text Generation
License: mit
Languages: en
Created: Mar 1, 2024
Updated: Mar 1, 2024