mmoffatt

custom_gpt2

mmoffatt/custom_gpt2

custom_gpt2 is a machine learning model from mmoffatt. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.

This is a custom implementation of gpt2, where we replace attention with our implementation. Currently, we don't replace softmax, but in future submits we would like to replace the softmax function in attention with o…