Downloads · 30 days
0
gpt-j-6B
OWG/gpt-j-6B
gpt-j-6B is a machine learning model from OWG. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as apache-2.0.
GPT-J 6B is a transformer model trained using Ben Wang's Mesh Transformer JAX. "GPT-J" refers to the class of model, while "6B" represents the number of trainable parameters.
Access
Public
Updated Apr 19, 2022
Repo size
24.2 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
Other23.4 GB · 96%
At a glance
- License
- apache-2.0
- Access
- Public
- Created
- Apr 14, 2022
- Updated
- Apr 19, 2022
- SHA
- 66e75753
Datasets
Model card
From the Hugging Face model README
GPT-J 6B
Model Description
GPT-J 6B is a transformer model trained using Ben Wang's Mesh Transformer JAX. "GPT-J" refers to the class of model, while "6B" represents the number of trainable parameters.
Original implementation
Follow this link to see the original implementation.
How to use
Download the model by cloning the repository via git clone https://huggingface.co/OWG/gpt-j-6B.
Then you can use the model with the following code:
from onnxruntime import InferenceSession, SessionOptions, GraphOptimizationLevel
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("EleutherAI/gpt-j-6B")
options = SessionOptions()
options.graph_optimization_level = GraphOptimizationLevel.ORT_ENABLE_ALL
session = InferenceSession("path/to/model.onnx", sess_options=options)
session.disable_fallback()
TODO
- License
- apache-2.0
- Languages
- en
- Created
- Apr 14, 2022
- Updated
- Apr 19, 2022