Downloads · 30 days
335
8% of all-time downloads
Eris_Floramix_DPO_7B-GGUF-Imatrix
Lewdiculous/Eris_Floramix_DPO_7B-GGUF-Imatrix
Eris_Floramix_DPO_7B-GGUF-Imatrix is a machine learning model from Lewdiculous. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as other.
This repository hosts GGUF-Imatrix quantizations for ChaoticNeutrals/ErisFloramixDPO7B.
All-time downloads
4.3K
Public
Repo size
47.9 GB
Likes
4
Public
Repo makeup
Click a slice to open those files.
.gguf47.9 GB · 100%
At a glance
- Library
- transformers
- License
- other
- Access
- Public
- Created
- Mar 8, 2024
- Updated
- Mar 8, 2024
- SHA
- 4c54bc83
Model card
From the Hugging Face model README
This repository hosts GGUF-Imatrix quantizations for ChaoticNeutrals/Eris_Floramix_DPO_7B.
Base⇢ GGUF(F16)⇢ Imatrix-Data(F16)⇢ GGUF(Imatrix-Quants)
quantization_options = [
"Q3_K_M", "Q4_K_M", "Q5_K_M", "Q6_K",
"Q8_0", "IQ4_XS", "IQ3_XXS"
]
This is experimental.
For imatrix data generation, kalomaze's groups_merged.txt with added roleplay chats was used, you can find it here.
The goal is to measure the (hopefully positive) impact of this data for consistent formatting in roleplay chatting scenarios.
Image:
Original model information:
Eris Floramix DPO
This is a mix between Eris Remix DPO and Flora DPO, a finetune of the original Eris Remix on the Synthetic_Soul_1k dataset.
Applied this DPO dataset: https://huggingface.co/datasets/athirdpath/DPO_Pairs-Roleplay-Alpaca-NSFW-v1-SHUFFLED
- Library
- transformers
- License
- other
- Languages
- en
- Created
- Mar 8, 2024
- Updated
- Mar 8, 2024