Doohae

lassl-koelectra-small

Doohae/lassl-koelectra-small

lassl-koelectra-small is a machine learning model from Doohae. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

- pretrained with large Korean corpus datasets (30GB) - 13.7M model parameters (followed google/electra-small-discriminator config) - 32,000 vocab size - trained for 1,000,000 steps - build with lassl framework