numen-tech

FuseChat-Llama-3.1-8B-Instruct-w4a16g128asym

numen-tech/FuseChat-Llama-3.1-8B-Instruct-w4a16g128asym

FuseChat-Llama-3.1-8B-Instruct-w4a16g128asym is a text generation model from numen-tech. Use it when you need the model to write or continue text. It is set up for mlc-llm. The card lists the license as llama3.1.

4-bit OmniQuant quantized version of FuseChat-Llama-3.1-8B-Instruct for inference with the Private LLM app.