Downloads · 30 days
5
19% of all-time downloads
position-specialist-speculative-decoding
position-specialist-speculative-decoding/Speed-E3-Llama3.1-8B-Instruct
Speed-E3-Llama3.1-8B-Instruct is a machine learning model from position-specialist-speculative-decoding. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
This repository provides the model checkpoint for SPEED, a speculative decoding method proposed in the anonymous paper:
Downloads · 30 days
5
19% of all-time downloads
All-time downloads
26
Public
Parameters
911M
1.8 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors1.8 GB · 100%
How the weights are stored.
BF16911M · 100%
From the Hugging Face model README
This repository provides the model checkpoint for SPEED, a speculative decoding method proposed in the anonymous paper:
SPEED: Specialized Position Experts for Efficient Speculative Decoding
pytorch_model.bin — model weightsconfig.json — model configuration