Downloads · 30 days
65
1% of all-time downloads
Mixtral-6x7B-Instruct-v0.1-bfloat16-Trimmed024567
DrNicefellow/Mixtral-6x7B-Instruct-v0.1-bfloat16-Trimmed024567
Mixtral-6x7B-Instruct-v0.1-bfloat16-Trimmed024567 is a text generation model from DrNicefellow. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
The Mixtral-6x7B-Instruct-v0.1 model is a derivative of the mistralai/Mixtral-8x7B-Instruct-v0.1 model. It was created by selectively trimming the original model and retaining only the 0th, 2nd, 4th, 5th, 6th, and 7th…
All-time downloads
7.3K
Public
Parameters
35.4B
70.9 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors70.9 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mixtral
- Access
- Public
- Created
- Apr 4, 2024
- Updated
- Apr 7, 2024
- SHA
- 1e124e91
Try a prompt
Model card
From the Hugging Face model README
Mixtral-6x7B-Instruct-v0.1 (bfloat16)
The Mixtral-6x7B-Instruct-v0.1 model is a derivative of the mistralai/Mixtral-8x7B-Instruct-v0.1 model. It was created by selectively trimming the original model and retaining only the 0th, 2nd, 4th, 5th, 6th, and 7th experts from each layer.
The trimming process was facilitated by the Mixtral-Expert-Trimmer tool, developed specifically for this purpose.
The model is still in testing phase. It is not clear whether it works.
License
The Mixtral-6x7B-Instruct-v0.1 model is open-source and licensed under the Apache 2.0 License. For more information, please refer to the LICENSE file.
Feeling Generous? 😊
Eager to buy me a cup of 2$ coffe or iced tea?🍵☕ Sure, here is the link: https://ko-fi.com/drnicefellow. Please add a note on which one you want me to drink?
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- apache-2.0
- Created
- Apr 4, 2024
- Updated
- Apr 7, 2024