Downloads · 30 days
6
5% of all-time downloads
IDEA-XL/progen2-large
progen2-large is a machine learning model from IDEA-XL. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as bsd-3-clause.
Modification of the base ProGen2-large model by Nijkamp, et al.. The vocabsize is changed from 51200 to 32, the same as the ProGen2-small and ProGen2-medium. The model follows the original code of Progen2.
Downloads · 30 days
6
5% of all-time downloads
All-time downloads
122
Public
Parameters
2.6B
10.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors10.1 GB · 100%
How the weights are stored.
F322.5B · 99%
From the Hugging Face model README
Modification of the base ProGen2-large model by Nijkamp, et al.. The vocab_size is changed from 51200 to 32, the same as the ProGen2-small and ProGen2-medium. The model follows the original code of Progen2.
Example usage:
from models.modeling_progen import ProGenForCausalLM
from tokenizers import Tokenizer
import torch
# load model and tokenizer
model = ProGenForCausalLM.from_pretrained("IDEA-XL/progen2-large", torch_dtype="auto")
tokenizer = Tokenizer.from_pretrained("IDEA-XL/progen2-large")
tokenizer.no_padding()
# prepare input
prompt = "1MEVVIVTGMSGAGK"
input_ids = torch.tensor(tokenizer.encode(prompt).ids).to(model.device)
# forward
logits = model(input_ids).logits