Downloads · 30 days
0
WizardLM-2-8x22B-model_stock
divinetaco/WizardLM-2-8x22B-model_stock
WizardLM-2-8x22B-model_stock is a machine learning model from divinetaco. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
A mergekit modelstock merge made with the aim of improving WizardLM-2-8x22B. The resulting model suppresses WizardLM-2-8x22B's overly flowery and positive writing style whilst retaining useful features such as CoT. Ex…
Access
Public
Updated Jun 3, 2024
Repo size
—
Likes
1
Public
Repo makeup
Click a slice to open those files.
.json3.1 MB · 100%
At a glance
- Access
- Public
- Created
- Jun 3, 2024
- Updated
- Jun 3, 2024
- SHA
- ba80e0dd
Base models
Model card
From the Hugging Face model README
WizardLM-2-8x22B-model_stock
A mergekit model_stock merge made with the aim of improving WizardLM-2-8x22B.
The resulting model suppresses WizardLM-2-8x22B's overly flowery and positive writing style whilst retaining useful features such as CoT. Extremely coherant even at long contexts, and benched above the WLM-2 base in intelligence tests.
Use vicuna prompt as per WizardLM-2-8x22B base.
exllamav2 measurement.json
mergekit_config.yml
models:
- model: alpindale/WizardLM-2-8x22B
- model: openbmb/Eurux-8x22b-kto
- model: openbmb/Eurux-8x22b-nca
- model: mistralai/Mixtral-8x22B-v0.1
- model: migtissera/Tess-2.0-Mixtral-8x22B
- model: fireworks-ai/mixtral-8x22b-instruct-oh
base_model: alpindale/WizardLM-2-8x22B
merge_method: model_stock
dtype: bfloat16
Likely won't be uploading the full weights myself due to bandwidth limitations.
- Created
- Jun 3, 2024
- Updated
- Jun 3, 2024