Downloads · 30 days
10
17% of all-time downloads
atrost/climbmix-matformer-353m-1p2b-h100-s-vllm
climbmix-matformer-353m-1p2b-h100-s-vllm is a machine learning model from atrost. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as cc-by-nc-4.0.
Native LlamaForCausalLM conversion of atrost/climbmix-matformer-353m-1p2b-h100-s.
Downloads · 30 days
10
17% of all-time downloads
All-time downloads
60
Public
Parameters
160M
639 MB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors639 MB · 99%
From the Hugging Face model README
Native LlamaForCausalLM conversion of atrost/climbmix-matformer-353m-1p2b-h100-s.
The source checkpoint was an extracted fixed-size MatFormer S submodel.
Because that submodel has fixed attention and MLP dimensions, its tensors can be
remapped losslessly into the standard Hugging Face Llama layout. This repo does
not require remote code and is intended to load through vLLM's native Llama path.
atrost/climbmix-matformer-353m-1p2b-h100-sa00c7878602eb5eb1f6fcb2cf3e3d1a03cc567000.000e+00from transformers import AutoModelForCausalLM, AutoTokenizer
repo_id = "atrost/climbmix-matformer-353m-1p2b-h100-s-vllm"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForCausalLM.from_pretrained(repo_id, torch_dtype="auto")
from vllm import LLM
llm = LLM(model="atrost/climbmix-matformer-353m-1p2b-h100-s-vllm")