Downloads · 30 days
26
14% of all-time downloads
furiosa-ai/DeepSeek-R1-Distill-Qwen-32B
DeepSeek-R1-Distill-Qwen-32B is a text generation model from furiosa-ai. Use it when you need the model to write or continue text. It is set up for furiosa-llm. The card lists the license as mit.
- Model Architecture: Qwen2 - Input: Text - Output: Text - Model Optimizations: - Context Length: 32k tokens - Maximum Prompt Length: 32768 tokens - Maximum Generation Length: 32768 tokens - Intended Use Cases: Intend…
Downloads · 30 days
26
14% of all-time downloads
All-time downloads
188
Public
Repo size
70.3 GB
Likes
0
Public
Click a slice to open those files.
.safetensors69.8 GB · 99%
From the Hugging Face model README
This model is the pre-compiled version of the deepseek-ai/DeepSeek-R1-Distill-Qwen-32B, which is an auto-regressive language model that uses an optimized transformer architecture.
To run this model with Furiosa-LLM, follow the example command below after installing Furiosa-LLM and its prerequisites.
furiosa-llm serve furiosa-ai/DeepSeek-R1-Distill-Qwen-32B \
--reasoning-parser deepseek_r1