llmware

DeepSeek-R1-Distill-Qwen-7B-ov-int4

llmware/DeepSeek-R1-Distill-Qwen-7B-ov-int4

DeepSeek-R1-Distill-Qwen-7B-ov-int4 is a machine learning model from llmware. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

This is the Deepseek-R1-Distill-Qwen-7B model, convert to OpenVINO with INT4 weight compression. This model is optimized for CPU and GPU. See llmware/DeepSeek-R1-Distill-Qwen-7B-ov-int4-npu for a version that works on…