Downloads · 30 days
306
8% of all-time downloads
TinyMistral-248M-Evol-Instruct-GGUF
afrideva/TinyMistral-248M-Evol-Instruct-GGUF
TinyMistral-248M-Evol-Instruct-GGUF is a text generation model from afrideva. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Quantized GGUF model files for TinyMistral-248M-Evol-Instruct from Felladrin
All-time downloads
3.6K
Public
Repo size
1 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf1 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Access
- Public
- Created
- Nov 21, 2023
- Updated
- Nov 23, 2023
- SHA
- 282891a0
Try a prompt
Base models
Model card
From the Hugging Face model README
Felladrin/TinyMistral-248M-Evol-Instruct-GGUF
Quantized GGUF model files for TinyMistral-248M-Evol-Instruct from Felladrin
| Name | Quant method | Size |
|---|---|---|
| tinymistral-248m-evol-instruct.q2_k.gguf | q2_k | 115.26 MB |
| tinymistral-248m-evol-instruct.q3_k_m.gguf | q3_k_m | 130.08 MB |
| tinymistral-248m-evol-instruct.q4_k_m.gguf | q4_k_m | 155.67 MB |
| tinymistral-248m-evol-instruct.q5_k_m.gguf | q5_k_m | 179.23 MB |
| tinymistral-248m-evol-instruct.q6_k.gguf | q6_k | 204.26 MB |
| tinymistral-248m-evol-instruct.q8_0.gguf | q8_0 | 264.32 MB |
Original Model Card:
Locutusque's TinyMistral-248M trained on the Evol Instruct dataset using AutoTrain
- Base model: Locutusque/TinyMistral-248M
- Dataset: KnutJaegersberg/WizardLM_evol_instruct_V2_196k_instruct_format
- Training: 9.5h under these parameters
Recommended Prompt Format
### Instruction:
<instruction>
### Response:
- Task
- Text Generation
- License
- apache-2.0
- Created
- Nov 21, 2023
- Updated
- Nov 23, 2023