numen-tech

Llama-3.3-70B-Instruct-w3a16g40sym

numen-tech/Llama-3.3-70B-Instruct-w3a16g40sym

Llama-3.3-70B-Instruct-w3a16g40sym is a text generation model from numen-tech. Use it when you need the model to write or continue text. It is set up for mlc-llm. The card lists the license as llama3.3.

3-bit OmniQuant quantized version of Llama-3.3-70B-Instruct for inference with the Private LLM app.