Downloads · 30 days
21
16% of all-time downloads
furiosa-ai/Qwen2.5-Coder-32B-Instruct
Qwen2.5-Coder-32B-Instruct is a text generation model from furiosa-ai. Use it when you need the model to write or continue text. It is set up for furiosa-llm. The card lists the license as apache-2.0.
- Model Architecture: Qwen2 - Input: Text - Output: Text - Model Optimizations: - Context Length: 32k tokens - Maximum Prompt Length: 32768 tokens - Maximum Generation Length: 32768 tokens - Intended Use Cases: Intend…
Downloads · 30 days
21
16% of all-time downloads
All-time downloads
131
Public
Repo size
67.2 GB
Likes
1
Public
Click a slice to open those files.
.safetensors66.6 GB · 99%
From the Hugging Face model README
This model is the pre-compiled version of the Qwen/Qwen2.5-Coder-32B-Instruct, which is an auto-regressive language model that uses an optimized transformer architecture.
To run this model with Furiosa-LLM, follow the example command below after installing Furiosa-LLM and its prerequisites.
furiosa-llm serve furiosa-ai/Qwen2.5-Coder-32B-Instruct