Downloads · 30 days
19
5% of all-time downloads
Air-Striker-Mixtral-8x7B-ZLoss-Instruct
sandmanbuzz/Air-Striker-Mixtral-8x7B-ZLoss-Instruct
Air-Striker-Mixtral-8x7B-ZLoss-Instruct is a text generation model from sandmanbuzz. Use it when you need the model to write or continue text. It is set up for transformers.
So, bro literally posts nothing but exl2s of this model, and it's like, am I some kind of caveman? What am I gonna do with an exl2? Take a picture of it and send it to my mom? So we re-made it from the ground up using…
All-time downloads
357
Public
Parameters
46.7B
93.4 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.safetensors93.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- mixtral
- Access
- Public
- Created
- Feb 22, 2024
- Updated
- Feb 22, 2024
- SHA
- b0cc528e
Try a prompt
Base models
Model card
From the Hugging Face model README
Air-Striker-Mixtral-8x7B-ZLoss-Instruct
So, bro literally posts nothing but exl2s of this model, and it's like, am I some kind of caveman? What am I gonna do with an exl2? Take a picture of it and send it to my mom? So we re-made it from the ground up using the lora, since at least dude's got that posted.
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the linear merge method.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: mistralai/Mixtral-8x7B-Instruct-v0.1
parameters:
weight: 0.5
- model: sandmanbuzz/Air-Striker-Mixtral-8x7B-ZLoss
parameters:
weight: 0.5
merge_method: linear
dtype: bfloat16
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- Created
- Feb 22, 2024
- Updated
- Feb 22, 2024