Downloads · 30 days
749
48% of all-time downloads
Qwen2.5-Hermes-Instruct-1.5B
koshuro/Qwen2.5-Hermes-Instruct-1.5B
Qwen2.5-Hermes-Instruct-1.5B is a text generation model from koshuro. Use it when you need the model to write or continue text. The card lists the license as mit.
This model was finetuned and converted to GGUF format on unsloth, fine tuned on 1million tokens (Or 2 epochs) of Hermes-Function-Calling, this in theory make this model accel at Hermes harness based tool calls, and ot…
All-time downloads
1.6K
Public
Repo size
8.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf8.9 GB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Model type
- qwen2
- Access
- Public
- Created
- Aug 22, 2026
- Updated
- Aug 22, 2026
- SHA
- b448dcab
Try a prompt
Base models
Model card
From the Hugging Face model README
Qwen2.5-Hermes-Instruct-1.5B : GGUF
This model was finetuned and converted to GGUF format on unsloth, fine tuned on 1million tokens (Or 2 epochs) of Hermes-Function-Calling, this in theory make this model accel at Hermes harness based tool calls, and other tasks.
Example usage:
- For text only LLMs:
llama-cli -hf koshuro/Qwen2.5-Hermes-Instruct-1.5B --jinja
Available Model files:
Qwen2.5-Hermes-Instruct-1.5B.Q3_K_M.ggufQwen2.5-Hermes-Instruct-1.5B.F16.ggufQwen2.5-Hermes-Instruct-1.5B.Q5_K_M.ggufQwen2.5-Hermes-Instruct-1.5B.Q6_K.ggufQwen2.5-Hermes-Instruct-1.5B.Q8_0.ggufQwen2.5-Hermes-Instruct-1.5B.Q4_K_M.gguf
- Task
- Text Generation
- Type
- qwen2
- License
- mit
- Languages
- en
- Created
- Aug 22, 2026
- Updated
- Aug 22, 2026