Downloads · 30 days
54
0% of all-time downloads
Mistral-7B-Merge-14-v0.3-ft-step-9984
EmbeddedLLM/Mistral-7B-Merge-14-v0.3-ft-step-9984
Mistral-7B-Merge-14-v0.3-ft-step-9984 is a text generation model from EmbeddedLLM. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This is fine-tuned model based on EmbeddedLLM/Mistral-7B-Merge-14-v0.3 for 9984 steps.
All-time downloads
17K
Public
Parameters
7.2B
29 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin14.5 GB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Jan 4, 2024
- Updated
- Jan 20, 2024
- SHA
- 66f26f17
Try a prompt
Base models
- mistralai/Mistral-7B-Instruct-v0.2
- ehartford/dolphin-2.2.1-mistral-7b
- SciPhi/SciPhi-Mistral-7B-32k
- ehartford/samantha-1.2-mistral-7b
- Arc53/docsgpt-7b-mistral
- HuggingFaceH4/zephyr-7b-beta
- meta-math/MetaMath-Mistral-7B
- Open-Orca/Mistral-7B-OpenOrca
- openchat/openchat-3.5-1210
- beowolx/MistralHermes-CodePro-7B-v1
- TIGER-Lab/MAmmoTH-7B-Mistral
- teknium/OpenHermes-2.5-Mistral-7B
- Weyaxi/OpenHermes-2.5-neural-chat-v3-3-Slerp
- mlabonne/NeuralHermes-2.5-Mistral-7B
- QuixiAI/samantha-1.2-mistral-7b
- dphn/dolphin-2.2.1-mistral-7b
Model card
From the Hugging Face model README
Model Description
This is fine-tuned model based on EmbeddedLLM/Mistral-7B-Merge-14-v0.3 for 9984 steps.
The dataset used are:
- dophin
- dolphin-coder
- Magicoder-OSS-Instruct-75K
- openhermes
- Synthia-v1.3
Chat Template
Prompt format: This model uses ChatML prompt format.
<|im_start|>system
You are Dolphin, a helpful AI assistant.<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant
Training
The model is scheduled to be fine-tuned for 3 epochs on 4 A100s using axolotl.
Shout-Out to OSS
Thank you to the Open Source AI community for bringing together marvelous code frameworks and datasets.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Jan 4, 2024
- Updated
- Jan 20, 2024