Downloads · 30 days
816
2% of all-time downloads
Locutusque/TinyMistral-248M-v2
TinyMistral-248M-v2 is a text generation model from Locutusque. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
This model was trained on two datasets, shown in this model page. - Skylion007/openwebtext: 1,000,000 examples at a batch size of 32-4096 (1 epoch) - Locutusque/TM-DATA: All examples at a batch size of 12288 (3 epochs…
Downloads · 30 days
816
2% of all-time downloads
All-time downloads
52.5K
Public
Parameters
248M
3 GB on disk
Likes
17
Public
Click a slice to open those files.
.bin992 MB · 50%
From the Hugging Face model README
This model was trained on two datasets, shown in this model page.
You can look at the training metrics here: https://wandb.ai/locutusque/TinyMistral-V2/runs/g0rvw6wc
🔥 This model performed excellently on TruthfulQA, outperforming models more than 720x its size. These models include: mistralai/Mixtral-8x7B-v0.1, tiiuae/falcon-180B, berkeley-nest/Starling-LM-7B-alpha, upstage/SOLAR-10.7B-v1.0, and more. 🔥