Downloads · 30 days
49
4% of all-time downloads
cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-GGUF
aplulu/cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-GGUF
cyberagent-DeepSeek-R1-Distill-Qwen-14B-Japanese-GGUF is a text generation model from aplulu. Use it when you need the model to write or continue text. The card lists the license as mit.
This repository provides a GGUF quantized version of the cyberagent/DeepSeek-R1-Distill-Qwen-14B-Japanese model from CyberAgent.
All-time downloads
1.2K
Public
Repo size
35.6 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.gguf35.6 GB · 100%
At a glance
- Task
- Text Generation
- License
- mit
- Access
- Public
- Created
- Jan 29, 2025
- Updated
- Jan 31, 2025
- SHA
- 489d1a08
Base models
Model card
From the Hugging Face model README
DeepSeek-R1-Distill-Qwen-14B-Japanese GGUF
Model Description
This repository provides a GGUF quantized version of the cyberagent/DeepSeek-R1-Distill-Qwen-14B-Japanese model from CyberAgent.
Choosing the Right Quantized Version
The choice of which quantized version to use depends your avilable VRAM:
-
= 8GB VRAM:
DeepSeek-R1-Distill-Qwen-14B-Japanese-IQ3_XS.gguf -
= 12GB VRAM:
DeepSeek-R1-Distill-Qwen-14B-Japanese-IQ4_XS.gguf -
= 12GB VRAM:
DeepSeek-R1-Distill-Qwen-14B-Japanese-Q4_K_M.gguf -
= 16GB VRAM:
DeepSeek-R1-Distill-Qwen-14B-Japanese-Q6_K.gguf
License
- Task
- Text Generation
- License
- mit
- Languages
- ja
- Created
- Jan 29, 2025
- Updated
- Jan 31, 2025