Downloads · 30 days
41
10% of all-time downloads
fxmeng/TransMLA-llama3-8b-8k
TransMLA-llama3-8b-8k is a machine learning model from fxmeng. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
To serve the model using vLLM, use the following command:
Downloads · 30 days
41
10% of all-time downloads
All-time downloads
391
Public
Parameters
7.9B
15.9 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors15.9 GB · 100%
From the Hugging Face model README
To serve the model using vLLM, use the following command:
# from [github repo](https://github.com/MuLabPKU/TransMLA)
import transmla.vllm_registry.deepseek
from vllm import LLM, SamplingParams
llm = LLM(model="fxmeng/TransMLA-llama3-8b-8k", trust_remote_code=True)