philschmid

gpt-j-6B-fp16-sharded

philschmid/gpt-j-6B-fp16-sharded

gpt-j-6B-fp16-sharded is a machine learning model from philschmid. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for generic.

This is fork of EleutherAI/gpt-j-6B with shareded fp16 weights implementing a custom handler.py as an example for how to use gpt-j inference-endpoints