Downloads · 30 days
1.2K
5% of all-time downloads
Qwen2.5-0.5B-Instruct-GGUF
gaianet/Qwen2.5-0.5B-Instruct-GGUF
Qwen2.5-0.5B-Instruct-GGUF is a text generation model from gaianet. Use it when you need the model to write or continue text. The card lists the license as apache-2.0.
All-time downloads
22.7K
Public
Repo size
11.2 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.gguf5.8 GB · 100%
At a glance
- Task
- Text Generation
- License
- apache-2.0
- Model type
- qwen2
- Access
- Public
- Created
- Sep 19, 2024
- Updated
- Apr 28, 2025
- SHA
- cdc89222
Base models
Model card
From the Hugging Face model README
Qwen2.5-0.5B-Instruct-GGUF
Original Model
Run with Gaianet
Prompt template
prompt template: chatml
Context size
chat_ctx_size: 32000
Run with GaiaNet
-
Quick start: https://docs.gaianet.ai/node-guide/quick-start
-
Customize your node: https://docs.gaianet.ai/node-guide/customize
Quantized with llama.cpp b4466
- Task
- Text Generation
- Type
- qwen2
- License
- apache-2.0
- Languages
- zho, eng, fra, spa, por, deu
- Created
- Sep 19, 2024
- Updated
- Apr 28, 2025