numen-tech

Llama-3.2-1B-Instruct-q0f16

numen-tech/Llama-3.2-1B-Instruct-q0f16

Llama-3.2-1B-Instruct-q0f16 is a text generation model from numen-tech. Use it when you need the model to write or continue text. It is set up for mlc-llm. The card lists the license as llama3.2.

Unquantized (fp16, the parent model is bf16) version of Llama-3.2-1B-Instruct for use with the Private LLM app.