Downloads · 30 days
165
3% of all-time downloads
DolphinLimaTrio-Mixtral-8x7b-GGUF
ycros/DolphinLimaTrio-Mixtral-8x7b-GGUF
DolphinLimaTrio-Mixtral-8x7b-GGUF is a machine learning model from ycros. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
5.7K
Public
Repo size
70.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf70.6 GB · 100%
At a glance
- Access
- Public
- Created
- Jan 11, 2024
- Updated
- Jan 11, 2024
- SHA
- 24f5fb58
Base models
Model card
From the Hugging Face model README
DolphinLimaTrio-Mixtral-8x7b
All credit to kalomaze
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the task arithmetic merge method using mistralai/Mixtral-8x7B-v0.1 as a base.
Models Merged
The following models were included in the merge:
- mistralai/Mixtral-8x7B-Instruct-v0.1
- cognitivecomputations/dolphin-2.5-mixtral-8x7b
- mistralai/Mixtral-8x7B-v0.1 + Doctor-Shotgun/limarp-zloss-mixtral-8x7b-qlora
Configuration
The following YAML configuration was used to produce this model:
merge_method: task_arithmetic
base_model: mistralai/Mixtral-8x7B-v0.1
models:
- model: mistralai/Mixtral-8x7B-Instruct-v0.1
parameters:
weight: 0.8
- model: cognitivecomputations/dolphin-2.5-mixtral-8x7b
parameters:
weight: 0.2
- model: mistralai/Mixtral-8x7B-v0.1+Doctor-Shotgun/limarp-zloss-mixtral-8x7b-qlora
parameters:
weight: 0.25
dtype: bfloat16
- Created
- Jan 11, 2024
- Updated
- Jan 11, 2024