Downloads · 30 days
247
35% of all-time downloads
Ma7ee7/MeetInstruct-0.6B-v1.5-GGUF
MeetInstruct-0.6B-v1.5-GGUF is a text generation model from Ma7ee7. Use it when you need the model to write or continue text. It is set up for llama.cpp.
GGUF conversions of Ma7ee7/MeetInstruct-0.6B-v1.5.
Downloads · 30 days
247
35% of all-time downloads
All-time downloads
704
Public
Repo size
6.6 GB
Likes
0
Public
Click a slice to open those files.
.gguf6.6 GB · 100%
From the Hugging Face model README
GGUF conversions of Ma7ee7/MeetInstruct-0.6B-v1.5.
The model is based on Qwen3-0.6B and uses its ChatML-compatible chat template.
| File | Size |
|---|---|
MeetInstruct-0.6B-v1.5-F16.gguf | 1439.4 MiB |
MeetInstruct-0.6B-v1.5-Q8_0.gguf | 767.5 MiB |
MeetInstruct-0.6B-v1.5-Q6_K.gguf | 593.9 MiB |
MeetInstruct-0.6B-v1.5-Q5_K_M.gguf | 525.8 MiB |
MeetInstruct-0.6B-v1.5-Q5_K_S.gguf | 518.4 MiB |
MeetInstruct-0.6B-v1.5-Q4_K_M.gguf | 461.8 MiB |
MeetInstruct-0.6B-v1.5-Q4_K_S.gguf | 449.0 MiB |
MeetInstruct-0.6B-v1.5-Q3_K_L.gguf | 415.2 MiB |
MeetInstruct-0.6B-v1.5-Q3_K_M.gguf | 394.8 MiB |
MeetInstruct-0.6B-v1.5-Q3_K_S.gguf | 371.9 MiB |
MeetInstruct-0.6B-v1.5-Q2_K.gguf | 331.2 MiB |
Recommended general-purpose quantization: MeetInstruct-0.6B-v1.5-Q4_K_M.gguf.
Run the model with:
llama-cli -m MeetInstruct-0.6B-v1.5-Q4_K_M.gguf -cnv
Context support depends on the underlying checkpoint and available memory. The v1.5 16K checkpoint was trained with examples between approximately 10,000 and 15,900 tokens, but long-context reliability is not guaranteed.
Generated locally using the current llama.cpp quantizer.
Successful quantizations: Q8_0, Q6_K, Q5_K_M, Q5_K_S, Q4_K_M, Q4_K_S, Q3_K_L, Q3_K_M, Q3_K_S, Q2_K.