Downloads · 30 days
205
10% of all-time downloads
Qwen2.5-Coder-1.5B-32B-speculative-GGUF
ggml-org/Qwen2.5-Coder-1.5B-32B-speculative-GGUF
Qwen2.5-Coder-1.5B-32B-speculative-GGUF is a text generation model from ggml-org. Use it when you need the model to write or continue text. It is set up for gguf. The card lists the license as apache-2.0.
All-time downloads
2K
Public
Repo size
21 GB
Likes
6
Public
Repo makeup
Click a slice to open those files.
.gguf21 GB · 100%
At a glance
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Access
- Public
- Created
- Dec 11, 2024
- Updated
- Dec 11, 2024
- SHA
- 99d96a3e
Try a prompt
Base models
Model card
From the Hugging Face model README
Speculative decoding with Qwen 32B + Qwen 1.5B
Example:
llama-server \
-m qwen2.5-coder-32b-instruct-q4_k_m.gguf \
-md qwen2.5-coder-1.5b-instruct-q4_k_m.gguf \
--ctx-size 65536
- Task
- Text Generation
- Library
- gguf
- License
- apache-2.0
- Languages
- en
- Created
- Dec 11, 2024
- Updated
- Dec 11, 2024