Downloads · 30 days
129
5% of all-time downloads
DeepSeek-R1-Llama-8B-F32-GGUF
prithivMLmods/DeepSeek-R1-Llama-8B-F32-GGUF
DeepSeek-R1-Llama-8B-F32-GGUF is a text generation model from prithivMLmods. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
DeepSeek-R1-Llama-8B-F32-GGUF is a quantized version of DeepSeek-R1-Distill-Llama-8B, trained using reinforcement learning (RL) directly on the base model without relying on supervised fine-tuning (SFT) as a prelimina…
All-time downloads
2.6K
Public
Repo size
63.8 GB
Likes
2
Public
Repo makeup
Click a slice to open those files.
.gguf63.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Jun 1, 2025
- Updated
- Jun 1, 2025
- SHA
- d59f776d
Try a prompt
Base models
Model card
From the Hugging Face model README
DeepSeek-R1-Llama-8B-F32-GGUF
DeepSeek-R1-Llama-8B-F32-GGUF is a quantized version of DeepSeek-R1-Distill-Llama-8B, trained using reinforcement learning (RL) directly on the base model without relying on supervised fine-tuning (SFT) as a preliminary step. This approach enables the model to explore chain-of-thought (CoT) reasoning for solving complex problems, leading to the development of DeepSeek-R1-Zero. DeepSeek-R1-Zero demonstrates capabilities such as self-verification, reflection, and generating extended chains of thought
Model File
| File Name | Size | Format | Notes |
|---|---|---|---|
| DeepSeek-R1-Llama-8B.BF16.gguf | 15.6 GB | GGUF | BF16 precision model |
| DeepSeek-R1-Llama-8B.F16.gguf | 16.1 GB | GGUF | FP16 precision model |
| DeepSeek-R1-Llama-8B.F32.gguf | 32.1 GB | GGUF | FP32 precision model |
| .gitattributes | 1.75 kB | Text | Git LFS tracking config |
| config.json | 31 B | JSON | Model configuration file |
| README.md | 767 B | Markdown | This readme file |
Quants Usage
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):
- Task
- Text Generation
- Library
- transformers
- Type
- llama
- License
- apache-2.0
- Languages
- en
- Created
- Jun 1, 2025
- Updated
- Jun 1, 2025