Downloads · 30 days
1.5K
1% of all-time downloads
sglang-EAGLE3-Llama-3.1-Instruct-8B
jamesliu1/sglang-EAGLE3-Llama-3.1-Instruct-8B
sglang-EAGLE3-Llama-3.1-Instruct-8B is a machine learning model from jamesliu1. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
This model is copied from https://huggingface.co/yuhuili/EAGLE3-LLaMA3.1-Instruct-8B with the following modifications to make it compatible with SGLang: - Modify the architecture in config.json to LlamaForCausalLMEagle3
All-time downloads
214K
Public
Repo size
1.7 GB
Likes
3
Public
Repo makeup
Click a slice to open those files.
.bin850 MB · 100%
At a glance
- License
- apache-2.0
- Model type
- llama
- Access
- Public
- Created
- Mar 8, 2025
- Updated
- Mar 9, 2025
- SHA
- e5ed08d6
Model card
From the Hugging Face model README
This model is copied from https://huggingface.co/yuhuili/EAGLE3-LLaMA3.1-Instruct-8B with the following modifications to make it compatible with SGLang:
- Modify the architecture in config.json to LlamaForCausalLMEagle3
- Type
- llama
- License
- apache-2.0
- Created
- Mar 8, 2025
- Updated
- Mar 9, 2025