jebcarter_-_Psyfighter-13B-gguf

RichardErkhov/jebcarter_-_Psyfighter-13B-gguf

jebcarter_-_Psyfighter-13B-gguf is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.

Downloads · 30 days

6% of all-time downloads

All-time downloads

784

Public

Repo size

147 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.gguf171 GB · 100%

At a glance

Access: Public
Created: Jul 25, 2024
Updated: Jul 26, 2024
SHA: f13f5e24

Model card

From the Hugging Face model README

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Psyfighter-13B - GGUF

Model creator: https://huggingface.co/jebcarter/
Original model: https://huggingface.co/jebcarter/Psyfighter-13B/

Name	Quant method	Size
Psyfighter-13B.Q2_K.gguf	Q2_K	4.52GB
Psyfighter-13B.IQ3_XS.gguf	IQ3_XS	4.99GB
Psyfighter-13B.IQ3_S.gguf	IQ3_S	5.27GB
Psyfighter-13B.Q3_K_S.gguf	Q3_K_S	5.27GB
Psyfighter-13B.IQ3_M.gguf	IQ3_M	5.57GB
Psyfighter-13B.Q3_K.gguf	Q3_K	5.9GB
Psyfighter-13B.Q3_K_M.gguf	Q3_K_M	5.9GB
Psyfighter-13B.Q3_K_L.gguf	Q3_K_L	6.45GB
Psyfighter-13B.IQ4_XS.gguf	IQ4_XS	6.54GB
Psyfighter-13B.Q4_0.gguf	Q4_0	6.86GB
Psyfighter-13B.IQ4_NL.gguf	IQ4_NL	6.9GB
Psyfighter-13B.Q4_K_S.gguf	Q4_K_S	6.91GB
Psyfighter-13B.Q4_K.gguf	Q4_K	7.33GB
Psyfighter-13B.Q4_K_M.gguf	Q4_K_M	7.33GB
Psyfighter-13B.Q4_1.gguf	Q4_1	7.61GB
Psyfighter-13B.Q5_0.gguf	Q5_0	8.36GB
Psyfighter-13B.Q5_K_S.gguf	Q5_K_S	8.36GB
Psyfighter-13B.Q5_K.gguf	Q5_K	8.6GB
Psyfighter-13B.Q5_K_M.gguf	Q5_K_M	8.6GB
Psyfighter-13B.Q5_1.gguf	Q5_1	9.1GB
Psyfighter-13B.Q6_K.gguf	Q6_K	9.95GB
Psyfighter-13B.Q8_0.gguf	Q8_0	12.88GB

Original model description:

license: llama2

merge_method: task_arithmetic
base_model: TheBloke/Llama-2-13B-fp16
models:
  - model: TheBloke/Llama-2-13B-fp16
  - model: KoboldAI/LLaMA2-13B-Tiefighter
    parameters:
      weight: 1.0
  - model: chaoyi-wu/MedLLaMA_13B
    parameters:
      weight: 0.01
  - model: Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged
    parameters:
      weight: 0.02
dtype: float16

This model was made possible thanks to the Compute provided by the KoboldAI community.

Created: Jul 25, 2024
Updated: Jul 26, 2024