numen-tech

FuseChat-Qwen-2.5-7B-Instruct-GPTQ-Int4

numen-tech/FuseChat-Qwen-2.5-7B-Instruct-GPTQ-Int4

FuseChat-Qwen-2.5-7B-Instruct-GPTQ-Int4 is a text generation model from numen-tech. Use it when you need the model to write or continue text. It is set up for mlc-llm. The card lists the license as apache-2.0.

4-bit GPTQ quantized version of FuseChat-Qwen-2.5-7B-Instruct for inference with the Private LLM app.