Downloads · 30 days
15
10% of all-time downloads
Zephyr-8x7b
AI4Chem/Zephyr-8x7b
Zephyr-8x7b is a text generation model from AI4Chem. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
We present to you the Zephyr-8x7b, a Mixtral 8x7B MoE model that SFT-only training on a dataset of nearly four million conversation corpora.
All-time downloads
149
Public
Parameters
46.7B
93.4 GB on disk
Likes
2
Public
Repo makeup
Click a slice to open those files.
.safetensors93.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- mit
- Model type
- mixtral
- Access
- Public
- Created
- Dec 18, 2023
- Updated
- Dec 21, 2023
- SHA
- 2b087de5
Model card
From the Hugging Face model README
Zephyr-8x7b:Zephyr Models but Mixtral 8x7B
We present to you the Zephyr-8x7b, a Mixtral 8x7B MoE model that SFT-only training on a dataset of nearly four million conversation corpora.
It has demonstrated strong contextual understanding, reasoning, and human moral alignment without alignment techniques like DPO, and we invite you to participate in our exploration!
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- mit
- Languages
- zh, en
- Created
- Dec 18, 2023
- Updated
- Dec 21, 2023