Downloads · 30 days
13
5% of all-time downloads
Psyfighter-13B-exl2-3bpw
mpasila/Psyfighter-13B-exl2-3bpw
Psyfighter-13B-exl2-3bpw is a text generation model from mpasila. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as llama2.
This is an ExLlamaV2 quantized model in 3bpw of jebcarter/Psyfighter-13B using PIPPA as the calibration dataset. (I might reupload this or add a new branch with a different version that uses the default calibration da…
All-time downloads
282
Public
Repo size
5.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- llama2
- Model type
- llama
- Access
- Public
- Created
- Jan 11, 2024
- Updated
- Mar 30, 2024
- SHA
- c95f6760
Try a prompt
Model card
From the Hugging Face model README
This is an ExLlamaV2 quantized model in 3bpw of jebcarter/Psyfighter-13B using PIPPA as the calibration dataset. (I might reupload this or add a new branch with a different version that uses the default calibration dataset instead)
Alpaca and ChatML prompt templates seem to work fine with this model.
Original Model card
merge_method: task_arithmaetic
base_model: TheBloke/Llama-2-13B-fp16
models:
- model: TheBloke/Llama-2-13B-fp16
- model: KoboldAI/LLaMA2-13B-Tiefighter
parameters:
weight: 1.0
- model: chaoyi-wu/MedLLaMA_13B
parameters:
weight: 0.01
- model: Doctor-Shotgun/llama-2-13b-chat-limarp-v2-merged
parameters:
weight: 0.02
dtype: float16
This model was made possible thanks to the Compute provided by the KoboldAI community.
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- llama2
- Languages
- en
- Created
- Jan 11, 2024
- Updated
- Mar 30, 2024