Downloads · 30 days
26.6K
7% of all-time downloads
TinyMistral-248M-v2-Instruct-GGUF
M4-ai/TinyMistral-248M-v2-Instruct-GGUF
TinyMistral-248M-v2-Instruct-GGUF is a machine learning model from M4-ai. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GGUF version of Locutusque/TinyMistral-248M-v2-Instruct.
All-time downloads
378K
Public
Repo size
1 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.gguf1 GB · 100%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Feb 3, 2024
- Updated
- Feb 3, 2024
- SHA
- 114104e3
Base models
Datasets
Model card
From the Hugging Face model README
Description
GGUF version of Locutusque/TinyMistral-248M-v2-Instruct.
Recommended inference parameters
do_sample: true
temperature: 0.1
top_p: 0.14
top_k: 12
repetition_penalty: 1.1
Recommended prompt template
<|im_start|>user\n{user message}<|im_end|>\n<|im_start|>assistant\n{assistant message}<|endoftext|>
- License
- apache-2.0
- Languages
- en
- Created
- Feb 3, 2024
- Updated
- Feb 3, 2024