Downloads · 30 days
59
4% of all-time downloads
TinyMistral-248M-v2.5-Instruct-GGUF
QuantFactory/TinyMistral-248M-v2.5-Instruct-GGUF
TinyMistral-248M-v2.5-Instruct-GGUF is a machine learning model from QuantFactory. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
All-time downloads
1.5K
Public
Repo size
2.3 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf2.3 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Oct 17, 2024
- Updated
- Oct 17, 2024
- SHA
- a4b44fea
Try a prompt
Base models
Model card
From the Hugging Face model README
QuantFactory/TinyMistral-248M-v2.5-Instruct-GGUF
This is quantized version of Locutusque/TinyMistral-248M-v2.5-Instruct created using llama.cpp
Original Model Card
Model description
Fine-tuned Locutusque/TinyMistral-248m-v2.5 on SlimOrca-Dedup and Hercules-v1.0. Averaged a loss of 1.5 during training. This model's performance is excellent considering it's size.
This model may output X-rated content. You and you alone are responsible for downloading and using the model and it's outputs. You have been warned.
You can use the ChatML prompt format for this model.
Evaluation
This model will be submitted to the Open LLM Leaderboard.
- License
- apache-2.0
- Languages
- en
- Created
- Oct 17, 2024
- Updated
- Oct 17, 2024