Downloads · 30 days
22
17% of all-time downloads
furiosa-ai/Qwen2.5-Coder-7B-Instruct
Qwen2.5-Coder-7B-Instruct is a text generation model from furiosa-ai. Use it when you need the model to write or continue text. It is set up for furiosa-llm. The card lists the license as apache-2.0.
- Model Architecture: Qwen2 - Input: Text - Output: Text - Model Optimizations: - Context Length: 32k tokens - Maximum Prompt Length: 32768 tokens - Maximum Generation Length: 32768 tokens - Intended Use Cases: Intend…
Downloads · 30 days
22
17% of all-time downloads
All-time downloads
126
Public
Repo size
16 GB
Likes
0
Public
Click a slice to open those files.
.safetensors15.7 GB · 98%
From the Hugging Face model README
This model is the pre-compiled version of the Qwen/Qwen2.5-Coder-7B-Instruct, which is an auto-regressive language model that uses an optimized transformer architecture.
To run this model with Furiosa-LLM, follow the example command below after installing Furiosa-LLM and its prerequisites.
furiosa-llm serve furiosa-ai/Qwen2.5-Coder-7B-Instruct