Downloads · 30 days
20
56% of all-time downloads
Locutusque_-_TinyMistral-248M-v2.5-Instruct-awq
RichardErkhov/Locutusque_-_TinyMistral-248M-v2.5-Instruct-awq
Locutusque_-_TinyMistral-248M-v2.5-Instruct-awq is a machine learning model from RichardErkhov. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
All-time downloads
36
Public
Parameters
248M
226 MB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors226 MB · 98%
Parameter types
How the weights are stored.
I32182M · 74%
Model card
From the Hugging Face model README
Quantization made by Richard Erkhov.
TinyMistral-248M-v2.5-Instruct - AWQ
- Model creator: https://huggingface.co/Locutusque/
- Original model: https://huggingface.co/Locutusque/TinyMistral-248M-v2.5-Instruct/
Original model description:
license: apache-2.0 datasets:
- Locutusque/hercules-v1.0
- Open-Orca/SlimOrca-Dedup language:
- en base_model: Locutusque/TinyMistral-248M-v2.5 tags:
- chemistry
- biology
- not-for-all-audiences
- merge
- code
inference:
parameters:
do_sample: true
renormalize_logits: false
temperature: 0.8
top_p: 0.14
top_k: 12
min_new_tokens: 2
max_new_tokens: 96
repetition_penalty: 1.15
no_repeat_ngram_size: 5
epsilon_cutoff: 0.002
widget:
- text: "<|im_start|>user\nWrite me a Python program that calculates the factorial of n. <|im_end|>\n<|im_start|>assistant\n"
Model description
Fine-tuned Locutusque/TinyMistral-248m-v2.5 on SlimOrca-Dedup and Hercules-v1.0. Averaged a loss of 1.5 during training. This model's performance is excellent considering it's size.
This model may output X-rated content. You and you alone are responsible for downloading and using the model and it's outputs. You have been warned.
You can use the ChatML prompt format for this model.
Evaluation
This model will be submitted to the Open LLM Leaderboard.
- Type
- mistral
- Created
- Dec 7, 2024
- Updated
- Dec 7, 2024