Downloads · 30 days
62
0% of all-time downloads
LocutusqueXFelladrin-TinyMistral248M-Instruct
Locutusque/LocutusqueXFelladrin-TinyMistral248M-Instruct
LocutusqueXFelladrin-TinyMistral248M-Instruct is a text generation model from Locutusque. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model was created by merging Locutusque/TinyMistral-248M-Instruct and Felladrin/TinyMistral-248M-SFT-v4 using mergekit. After the two models were merged, the resulting model was further trained on ~20,000 example…
All-time downloads
46.2K
Public
Parameters
248M
993 MB on disk
Likes
7
Public
Repo makeup
Click a slice to open those files.
.bin496 MB · 50%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- mistral
- Access
- Public
- Created
- Dec 14, 2023
- Updated
- Feb 1, 2025
- SHA
- c801d563
Try a prompt
Datasets
Model card
From the Hugging Face model README
LocutusqueXFelladrin-TinyMistral248M-Instruct
This model was created by merging Locutusque/TinyMistral-248M-Instruct and Felladrin/TinyMistral-248M-SFT-v4 using mergekit. After the two models were merged, the resulting model was further trained on ~20,000 examples on the Locutusque/inst_mix_v2_top_100k at a low learning rate to further normalize weights. The following is the YAML config used to merge:
models:
- model: Felladrin/TinyMistral-248M-SFT-v4
parameters:
weight: 0.5
- model: Locutusque/TinyMistral-248M-Instruct
parameters:
weight: 1.0
merge_method: linear
dtype: float16
The resulting model combines the best of both worlds. With Locutusque/TinyMistral-248M-Instruct's coding capabilities and reasoning skills, and Felladrin/TinyMistral-248M-SFT-v4's low hallucination and instruction-following capabilities. The resulting model has an incredible performance considering its size.
Evaluation
Found in the Open LLM Leaderboard.
- Task
- Text Generation
- Library
- transformers
- Type
- mistral
- License
- apache-2.0
- Languages
- en
- Created
- Dec 14, 2023
- Updated
- Feb 1, 2025