Downloads · 30 days
20
31% of all-time downloads
fairseq-dense-125m
pingzhili/fairseq-dense-125m
fairseq-dense-125m is a text generation model from pingzhili. Use it when you need the model to write or continue text. It is set up for transformers.
This is a Hugging Face transformers-style conversion of the original dense 125M-parameter model from the paper "Efficient Large Scale Language Modeling with Mixtures of Experts" from Artetxe et al. The original model…
All-time downloads
64
Public
Repo size
498 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin498 MB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- Access
- Public
- Created
- Sep 22, 2023
- Updated
- Sep 23, 2023
- SHA
- 91551f34
Try a prompt
Model card
From the Hugging Face model README
This is a Hugging Face transformers-style conversion of the original dense 125M-parameter model from the paper "Efficient Large Scale Language Modeling with Mixtures of Experts" from Artetxe et al. The original model card can be found at https://github.com/facebookresearch/fairseq/blob/main/examples/moe_lm/model_card.md.
The usage example and modeling code can be found at https://github.com/pingzhili/light-fairseq
- Task
- Text Generation
- Library
- transformers
- Languages
- en
- Created
- Sep 22, 2023
- Updated
- Sep 23, 2023