Downloads · 30 days
16
5% of all-time downloads
albert-cda
fairnlp/albert-cda
albert-cda is a feature extraction model from fairnlp. Use it when you need embeddings to search or compare text. It is set up for transformers. The card lists the license as apache-2.0.
Pretrained model on English language using a masked language modeling (MLM) objective. It was introduced in this paper and first released in this repository. The model is pre-trained from scratch over Wikipedia. Word…
All-time downloads
305
Public
Repo size
142 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin70.7 MB · 96%
At a glance
- Task
- Feature Extraction
- Library
- transformers
- License
- apache-2.0
- Model type
- albert
- Access
- Public
- Created
- Jan 12, 2024
- Updated
- Jan 12, 2024
- SHA
- d527744b
Datasets
Model card
From the Hugging Face model README
ALBERT Large (CDA) - Counterfactual Data Augmentation
Pretrained model on English language using a masked language modeling (MLM) objective. It was introduced in this paper and first released in this repository. The model is pre-trained from scratch over Wikipedia. Word substitutions for data augmentation are determined using the word lists provided at corefBias (Zhao et al. (2018)).
Disclaimer: The team releasing ALBERT did not write a model card for this model so this model card has been written by the FairNLP team.
BibTeX entry and citation info
@misc{zari,
title={Measuring and Reducing Gendered Correlations in Pre-trained Models},
author={Kellie Webster and Xuezhi Wang and Ian Tenney and Alex Beutel and Emily Pitler and Ellie Pavlick and Jilin Chen and Slav Petrov},
year={2020},
eprint={2010.06032},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
- Task
- Feature Extraction
- Library
- transformers
- Type
- albert
- License
- apache-2.0
- Languages
- en
- Created
- Jan 12, 2024
- Updated
- Jan 12, 2024