numen-tech

DeepSeek-R1-Distill-Llama-70B-w4a16g128sym

numen-tech/DeepSeek-R1-Distill-Llama-70B-w4a16g128sym

DeepSeek-R1-Distill-Llama-70B-w4a16g128sym is a text generation model from numen-tech. Use it when you need the model to write or continue text. It is set up for mlc-llm. The card lists the license as mit.

4-bit OmniQuant quantized version of DeepSeek-R1-Distill-Llama-70B for inference with the Private LLM app.