Downloads · 30 days
70
1% of all-time downloads
Mixtral-8x7b-v0.1-sft
vistagi/Mixtral-8x7b-v0.1-sft
Mixtral-8x7b-v0.1-sft is a text generation model from vistagi. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model vistagi/Mixtral-8x7b-v0.1-sft is trained with Ultrachat-200K dataset through supervised finetuning using Mixtral-8x7b-v0.1 as the baseline model. The training is done with bfloat16 precision using LoRA.
All-time downloads
10.8K
Public
Parameters
46.7B
187 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors93.4 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mixtral
- Access
- Public
- Created
- Feb 14, 2024
- Updated
- Feb 18, 2024
- SHA
- 50871bc7
Try a prompt
Datasets
Model card
From the Hugging Face model README
Introduction
This model vistagi/Mixtral-8x7b-v0.1-sft is trained with Ultrachat-200K dataset through supervised finetuning using Mixtral-8x7b-v0.1 as the baseline model. The training is done with bfloat16 precision using LoRA.
Details
Used Librarys
- torch
- deepspeed
- pytorch lightning
- transformers
- peft
- Task
- Text Generation
- Library
- transformers
- Type
- mixtral
- License
- apache-2.0
- Languages
- en
- Created
- Feb 14, 2024
- Updated
- Feb 18, 2024