bunnycore_-_Phi-2-OmniMatrix-gguf

RichardErkhov/bunnycore_-_Phi-2-OmniMatrix-gguf

bunnycore_-_Phi-2-OmniMatrix-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Downloads · 30 days

207

9% of all-time downloads

All-time downloads

2.4K

Public

Repo size

32.2 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf37.4 GB · 100%

At a glance

Access: Public
Created: Oct 6, 2024
Updated: Oct 6, 2024
SHA: f0004f8d

Model card

From the Hugging Face model README

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Phi-2-OmniMatrix - GGUF

Model creator: https://huggingface.co/bunnycore/
Original model: https://huggingface.co/bunnycore/Phi-2-OmniMatrix/

Name	Quant method	Size
Phi-2-OmniMatrix.Q2_K.gguf	Q2_K	1.03GB
Phi-2-OmniMatrix.IQ3_XS.gguf	IQ3_XS	1.12GB
Phi-2-OmniMatrix.IQ3_S.gguf	IQ3_S	1.16GB
Phi-2-OmniMatrix.Q3_K_S.gguf	Q3_K_S	1.16GB
Phi-2-OmniMatrix.IQ3_M.gguf	IQ3_M	1.23GB
Phi-2-OmniMatrix.Q3_K.gguf	Q3_K	1.33GB
Phi-2-OmniMatrix.Q3_K_M.gguf	Q3_K_M	1.33GB
Phi-2-OmniMatrix.Q3_K_L.gguf	Q3_K_L	1.47GB
Phi-2-OmniMatrix.IQ4_XS.gguf	IQ4_XS	1.43GB
Phi-2-OmniMatrix.Q4_0.gguf	Q4_0	1.49GB
Phi-2-OmniMatrix.IQ4_NL.gguf	IQ4_NL	1.5GB
Phi-2-OmniMatrix.Q4_K_S.gguf	Q4_K_S	1.51GB
Phi-2-OmniMatrix.Q4_K.gguf	Q4_K	1.62GB
Phi-2-OmniMatrix.Q4_K_M.gguf	Q4_K_M	1.62GB
Phi-2-OmniMatrix.Q4_1.gguf	Q4_1	1.65GB
Phi-2-OmniMatrix.Q5_0.gguf	Q5_0	1.8GB
Phi-2-OmniMatrix.Q5_K_S.gguf	Q5_K_S	1.8GB
Phi-2-OmniMatrix.Q5_K.gguf	Q5_K	1.87GB
Phi-2-OmniMatrix.Q5_K_M.gguf	Q5_K_M	1.87GB
Phi-2-OmniMatrix.Q5_1.gguf	Q5_1	1.95GB
Phi-2-OmniMatrix.Q6_K.gguf	Q6_K	2.13GB
Phi-2-OmniMatrix.Q8_0.gguf	Q8_0	2.75GB

Original model description:

base_model:

microsoft/phi-2
Artples/L-MChat-Small
minghaowu/phi-2-OpenHermes-2.5
kingabzpro/phi-2-role-play
parsak/phi-2-code-instruct
l3utterfly/phi-2-layla-v1-chatml library_name: transformers tags:
mergekit
merge

merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the task arithmetic merge method using microsoft/phi-2 as a base.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:


models:
  - model: minghaowu/phi-2-OpenHermes-2.5+kingabzpro/phi-2-role-play
    parameters:
      weight: 1.0
  - model: Artples/L-MChat-Small
    parameters:
      weight: 1.0
  - model: l3utterfly/phi-2-layla-v1-chatml
    parameters:
      weight: 1.0
  - model: parsak/phi-2-code-instruct
    parameters:
      weight: 1.0
merge_method: task_arithmetic
base_model: microsoft/phi-2
parameters:
    normalize: false
dtype: float16

Created: Oct 6, 2024
Updated: Oct 6, 2024