model-attribution-challenge

fairseq-dense-125M

model-attribution-challenge/fairseq-dense-125M

fairseq-dense-125M is a text generation model from model-attribution-challenge. Use it when you need the model to write or continue text. It is set up for transformers.

This is a Hugging Face transformers-compatible conversion of the original dense 125M-parameter model from the paper "Efficient Large Scale Language Modeling with Mixtures of Experts" from Artetxe et al. Please refer t…