Downloads · 30 days
4
19% of all-time downloads
TehVenom_-_Pygmalion-Vicuna-1.1-7b-4bits
RichardErkhov/TehVenom_-_Pygmalion-Vicuna-1.1-7b-4bits
TehVenom_-_Pygmalion-Vicuna-1.1-7b-4bits is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
21
Public
Parameters
6.8B
4.2 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.2 GB · 100%
Parameter types
How the weights are stored.
U86.5B · 95%
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
Pygmalion-Vicuna-1.1-7b - bnb 4bits
- Model creator: https://huggingface.co/TehVenom/
- Original model: https://huggingface.co/TehVenom/Pygmalion-Vicuna-1.1-7b/
Original model description: The LLaMA based Pygmalion-7b model:
https://huggingface.co/PygmalionAI/pygmalion-7b
Merged alongside lmsys's Vicuna v1.1 deltas:
https://huggingface.co/lmsys/vicuna-13b-delta-v1.1
This merge was done using an weighted average merge strategy, and the end result is a model composed of:
Pygmalion-7b [60%] + LLaMA Vicuna v1.1 [40%]
This was done under request, but the end result is intended to lean heavily towards Pygmalion's chatting + RP tendencies, and to inherit some of Vicuna's Assistant / Instruct / Helpful properties.
Due to the influence of Pygmalion, this model will very likely generate content that is considered NSFW.
The specific prompting is unknown, but try Pygmalion's prompt styles first, then a mix of the two to see what brings most interesting results.
Treat this as a normal HF Transformers model.
- Type
- llama
- Created
- Sep 25, 2024
- Updated
- Sep 25, 2024