dccuchile

albert-xxlarge-spanish

dccuchile/albert-xxlarge-spanish

albert-xxlarge-spanish is a machine learning model from dccuchile. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.

This is an ALBERT model trained on a big spanish corpora. The model was trained on a single TPU v3-8 with the following hyperparameters and steps/time: - LR: 0.0003125 - Batch Size: 128 - Warmup ratio: 0.00078125 - Wa…