Downloads · 30 days
23
5% of all-time downloads
levanter-backpack-1b-100k
ivanzhouyq/levanter-backpack-1b-100k
levanter-backpack-1b-100k is a text generation model from ivanzhouyq. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Please install transformers, safetensors and torch to use this model.
All-time downloads
478
Public
Parameters
1.4B
5.7 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors5.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- backpack-gpt2
- Access
- Public
- Created
- May 31, 2023
- Updated
- May 31, 2023
- SHA
- c3ef69ad
Try a prompt
Datasets
Model card
From the Hugging Face model README
How to Get Started with the Model
Please install transformers, safetensors and torch to use this model.
pip install transformers safetensors torch
Run the following Python code:
import torch
import transformers
from transformers import AutoModelForCausalLM
model_id = "ivanzhouyq/levanter-backpack-1b-100k"
config = transformers.AutoConfig.from_pretrained(model_id, trust_remote_code=True)
torch_model = AutoModelForCausalLM.from_pretrained(
model_id,
config=config,
trust_remote_code=True
)
torch_model.eval()
input = torch.randint(0, 50264, (1, 512), dtype=torch.long)
torch_out = torch_model(input, position_ids=None,)
torch_out = torch.nn.functional.softmax(torch_out.logits, dim=-1)
print(torch_out.shape)
- Task
- Text Generation
- Library
- transformers
- Type
- backpack-gpt2
- License
- apache-2.0
- Languages
- en
- Created
- May 31, 2023
- Updated
- May 31, 2023