Downloads · 30 days
9
8% of all-time downloads
atrost/climbmix-stairformer-353m-1p2b-h100-vllm
climbmix-stairformer-353m-1p2b-h100-vllm is a machine learning model from atrost. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
vLLM Transformers-backend packaging of atrost/climbmix-stairformer-353m-1p2b-h100.
Downloads · 30 days
9
8% of all-time downloads
All-time downloads
106
Public
Parameters
558M
2.2 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors2.2 GB · 100%
From the Hugging Face model README
vLLM Transformers-backend packaging of atrost/climbmix-stairformer-353m-1p2b-h100.
This repo keeps the original weights and adds an auto_map.AutoModel entry plus
remote code whose StairFormer customization lives in StairFormerModel, the base
model class required by vLLM's Transformers backend.
atrost/climbmix-stairformer-353m-1p2b-h1004de1d6dfc052d2fe944485d68a6db0588dd70accfrom transformers import AutoModelForCausalLM, AutoTokenizer
repo_id = "atrost/climbmix-stairformer-353m-1p2b-h100-vllm"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForCausalLM.from_pretrained(
repo_id,
trust_remote_code=True,
torch_dtype="auto",
)
from vllm import LLM
llm = LLM(model="atrost/climbmix-stairformer-353m-1p2b-h100-vllm", trust_remote_code=True, model_impl="transformers")