Downloads · 30 days
208
6% of all-time downloads
Hunyuan-0.5B-Instruct-GGUF
Fu01978/Hunyuan-0.5B-Instruct-GGUF
Hunyuan-0.5B-Instruct-GGUF is a text generation model from Fu01978. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as other.
This repository contains GGUF quants for tencent/Hunyuan-0.5B-Instruct.
All-time downloads
3.6K
Public
Repo size
5.5 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf5.5 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- other
- Access
- Public
- Created
- Jan 31, 2026
- Updated
- Jan 31, 2026
- SHA
- 9541dd48
Try a prompt
Base models
Model card
From the Hugging Face model README
Hunyuan-0.5B-Instruct-GGUF
This repository contains GGUF quants for tencent/Hunyuan-0.5B-Instruct.
Hunyuan-0.5B is part of Tencent's efficient LLM series, featuring Hybrid Reasoning (fast and slow thinking modes) and a native 256K context window. Even at 0.5B parameters, it inherits robust performance from larger Hunyuan models, making it ideal for edge devices and resource-constrained environments.
Usage
llama.cpp
You can run these quants using the llama.cpp CLI:
./llama-cli -m Hunyuan-0.5B-Instruct*.gguf -p "Your prompt here" -n 128
Special Features
- Thinking Mode: This model supports "slow-thinking" reasoning. To disable CoT (Chain of Thought), add
/no_thinkbefore your prompt or setenable_thinking=Falsein your chat template. - Long Context: Natively supports 256K tokens
- Task
- Text Generation
- Library
- gguf
- License
- other
- Languages
- en, zh
- Created
- Jan 31, 2026
- Updated
- Jan 31, 2026