Downloads · 30 days
46
2% of all-time downloads
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2-GGUF
QuantFactory/TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2-GGUF
TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2-GGUF is a machine learning model from QuantFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
All-time downloads
2.6K
Public
Repo size
87.4 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf72.7 GB · 100%
At a glance
- License
- cc-by-nc-4.0
- Access
- Public
- Created
- Jul 11, 2024
- Updated
- Jul 18, 2024
- SHA
- d896a3c7
Model card
From the Hugging Face model README
QuantFactory/TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2-GGUF
This is quantized version of cgato/TheSalt-RP-L3-8b-DPO-v0.3.2-e0.14.2 created using llama.cpp
Original Model Card
An experimental llama3 RP model, stuffed with lots of tokens and then DPO'd for RP. Making it public so people can give me feedback and mess around with it.
Uses ChatML but you have to format it a certain way. The usernames are required, a system prompt is required.
Datasets Used?
- Yes.
Prompt Format ( ChatML with usernames. )
<|im_start|>system
{System Prompt}<|im_end|>
<|im_start|>user
{username}: {usertext}<|im_end|>
<|im_start|>assistant
{botname}: {bottext}<|im_end|>
<|im_start|>user
{username}: {usertext}<|im_end|>
<|im_start|>assistant
{botname}:
Disclaimer
Please prompt responsibly and take anything outputted by any Language Model with a huge grain of salt. Thanks!
- License
- cc-by-nc-4.0
- Created
- Jul 11, 2024
- Updated
- Jul 18, 2024