Downloads · 30 days
114
7% of all-time downloads
jsfs11/WestOrcaNeuralMarco-DPO-v2-DARETIES-7B-GGUF
WestOrcaNeuralMarco-DPO-v2-DARETIES-7B-GGUF is a machine learning model from jsfs11. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
WestOrcaNeuralMarco-DPO-v2-DARETIES-7B is a merge of the following models using LazyMergekit: senseable/Westlake-7B-v2 decruz07/kellemar-DPO-Orca-Distilled-7B-SLERP
Downloads · 30 days
114
7% of all-time downloads
All-time downloads
1.7K
Public
Repo size
18.8 GB
Likes
1
Public
Click a slice to open those files.
.gguf18.8 GB · 100%
From the Hugging Face model README
WestOrcaNeuralMarco-DPO-v2-DARETIES-7B is a merge of the following models using LazyMergekit:
models:
- model: mistralai/Mistral-7B-v0.1
# No parameters necessary for base model
- model: senseable/Westlake-7B-v2
parameters:
density: 0.73
weight: 0.4
- model: decruz07/kellemar-DPO-Orca-Distilled-7B-SLERP
parameters:
density: 0.55
weight: 0.3
- model: mlabonne/NeuralMarcoro14-7B
parameters:
density: 0.45
weight: 0.3
merge_method: dare_ties
base_model: mistralai/Mistral-7B-v0.1
parameters:
int8_mask: true
dtype: bfloat16
Credit to Maxime Labonne and his excellent blog https://mlabonne.github.io/blog/.