qywu

sglang-EAGLE3-Llama-3.1-Instruct-8B

qywu/sglang-EAGLE3-Llama-3.1-Instruct-8B

sglang-EAGLE3-Llama-3.1-Instruct-8B is a machine learning model from qywu. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.

This model is copied from https://huggingface.co/yuhuili/EAGLE3-LLaMA3.1-Instruct-8B with the following modifications to make it compatible with SGLang: - Modify the architecture in config.json to LlamaForCausalLMEagle3