Downloads · 30 days
29
5% of all-time downloads
compoundpiece-stage1
benjamin/compoundpiece-stage1
compoundpiece-stage1 is a machine learning model from benjamin. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as mit.
CompoundPiece model trained only on Stage 1 training data (self-supervised training on hyphenated and non-hyphenated words scraped from the web). See CompoundPiece: Evaluating and Improving Decompounding Performance o…
All-time downloads
582
Public
Repo size
9.1 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin2.3 GB · 34%
At a glance
- Library
- transformers
- License
- mit
- Model type
- t5
- Access
- Public
- Created
- May 13, 2023
- Updated
- Jul 24, 2023
- SHA
- a6ac916d
Datasets
Model card
From the Hugging Face model README
CompoundPiece model trained only on Stage 1 training data (self-supervised training on hyphenated and non-hyphenated words scraped from the web). See CompoundPiece: Evaluating and Improving Decompounding Performance of Language Models.
Citation
@article{minixhofer2023compoundpiece,
title={CompoundPiece: Evaluating and Improving Decompounding Performance of Language Models},
author={Minixhofer, Benjamin and Pfeiffer, Jonas and Vuli{\'c}, Ivan},
journal={arXiv preprint arXiv:2305.14214},
year={2023}
}
License
MIT
- Library
- transformers
- Type
- t5
- License
- mit
- Languages
- af, az, be, bg, bn, ca
- Created
- May 13, 2023
- Updated
- Jul 24, 2023