Downloads · 30 days
0
DeepSeek-R1-Distill-Llama-8B-Distributed-Llama
b4rtaz/DeepSeek-R1-Distill-Llama-8B-Distributed-Llama
DeepSeek-R1-Distill-Llama-8B-Distributed-Llama is a text generation model from b4rtaz. Use it when you need the model to write or continue text. It is set up for distributed-llama. The card lists the license as mit.
This is converted DeepSeek R1 Distill 8B model to Distributed Llama format. The model is quantized to Q40.
Access
Public
Updated Feb 25, 2025
Repo size
6.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.m6.3 GB · 100%
At a glance
- Task
- Text Generation
- Library
- distributed-llama
- License
- mit
- Access
- Public
- Created
- Feb 15, 2025
- Updated
- Feb 25, 2025
- SHA
- 2d871d2b
Try a prompt
Model card
From the Hugging Face model README
This is converted DeepSeek R1 Distill 8B model to Distributed Llama format. The model is quantized to Q40.
🚀 How to Run?
- ⏬ Download this repository.
- ⏬ Download Distributed Llama repository.
- 🔨 Build Distributed Llama:
make dllama
🚀 Run Distributed Llama:
./dllama chat --model dllama_model_deepseek-r1-distill-llama-8b_q40.m --tokenizer dllama_tokenizer_deepseek-r1-distill-llama-8b.t --buffer-float-type q80 --nthreads 4 --max-seq-len 8192
🎩 License
- Task
- Text Generation
- Library
- distributed-llama
- License
- mit
- Created
- Feb 15, 2025
- Updated
- Feb 25, 2025