Downloads · 30 days
520
9% of all-time downloads
afrideva/TinyMistral-248M-Alpaca-GGUF
TinyMistral-248M-Alpaca-GGUF is a text generation model from afrideva. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
Quantized GGUF model files for TinyMistral-248M-Alpaca from Felladrin
Downloads · 30 days
520
9% of all-time downloads
All-time downloads
5.7K
Public
Repo size
1.5 GB
Likes
2
Public
Click a slice to open those files.
.gguf1.5 GB · 100%
From the Hugging Face model README
Quantized GGUF model files for TinyMistral-248M-Alpaca from Felladrin
| Name | Quant method | Size |
|---|---|---|
| tinymistral-248m-alpaca.q2_k.gguf | q2_k | 115.26 MB |
| tinymistral-248m-alpaca.q3_k_m.gguf | q3_k_m | 130.08 MB |
| tinymistral-248m-alpaca.q4_k_m.gguf | q4_k_m | 155.67 MB |
| tinymistral-248m-alpaca.q5_k_m.gguf | q5_k_m | 179.23 MB |
| tinymistral-248m-alpaca.q6_k.gguf | q6_k | 204.26 MB |
| tinymistral-248m-alpaca.q8_0.gguf | q8_0 | 264.32 MB |
The training used these two following formats.
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
<instruction>
### Response:
Below is an instruction that describes a task, paired with an input that provides further context. Write a response that appropriately completes the request.
### Instruction:
<instruction>
### Input:
<input>
### Response: