Downloads · 30 days
23
12% of all-time downloads
DeepSeek-R1-Distill-Llama-70B
furiosa-ai/DeepSeek-R1-Distill-Llama-70B
DeepSeek-R1-Distill-Llama-70B is a text generation model from furiosa-ai. Use it when you need the model to write or continue text. It is set up for furiosa-llm. The card lists the license as mit.
- Model Architecture: Meta-Llama-3 - Input: Text - Output: Text - Model Optimizations: - Context Length: 32k tokens - Maximum Prompt Length: 32768 tokens - Maximum Generation Length: 32768 tokens - Intended Use Cases:…
All-time downloads
187
Public
Repo size
154 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors152 GB · 99%
At a glance
- Task
- Text Generation
- Library
- furiosa-llm
- License
- mit
- Model type
- llama
- Access
- Public
- Created
- Jul 24, 2025
- Updated
- Sep 19, 2025
- SHA
- d3308602
Try a prompt
Base models
Model card
From the Hugging Face model README
Model Overview
- Model Architecture: Meta-Llama-3
- Input: Text
- Output: Text
- Model Optimizations:
- Context Length: 32k tokens
- Maximum Prompt Length: 32768 tokens
- Maximum Generation Length: 32768 tokens
- Intended Use Cases: Intended for commercial and non-commercial use. Same as DeepSeek-R1-Distill-Llama-70B, this models is intended for assistant-like chat.
- Release Date: 08/04/2025
- Version: v2025.3
- License(s): MIT License
- Supported Inference Engine(s): Furiosa LLM
- Supported Hardware Compatibility: FuriosaAI RNGD
- Preferred Operating System(s): Linux
- Quantization: No
Description:
This model is the pre-compiled version of the DeepSeek-R1-Distill-Llama-70B, which is an auto-regressive language model that uses an optimized transformer architecture.
Usage
To run this model with Furiosa-LLM, follow the example command below after installing Furiosa-LLM and its prerequisites.
furiosa-llm serve furiosa-ai/DeepSeek-R1-Distill-Llama-70B --reasoning-parser deepseek_r1
- Task
- Text Generation
- Library
- furiosa-llm
- Type
- llama
- License
- mit
- Created
- Jul 24, 2025
- Updated
- Sep 19, 2025