RedHatAI
DeepSeek-R1-quantized.w4a16
Based on deepseek-ai/DeepSeek-R1
Tags
- safetensors
- deepseek
- neuralmagic
- redhat
- llmcompressor
- quantized
- INT4
- GPTQ
- base_model:deepseek-ai/DeepSeek-R1
- base_model:finetune:deepseek-ai/DeepSeek-R1
- license:mit
- region:us
- Author
- RedHatAI
- Task
- text-generation
- Library
- vllm
- License
- mit
- Base model
- deepseek-ai/DeepSeek-R1
- Downloads
- 264
- Likes
- 7