Downloads · 30 days
13
6% of all-time downloads
perplexity-correlations/fasttext-lambada-fr-target
fasttext-lambada-fr-target is a text classification model from perplexity-correlations. Use it when you need a label for a piece of text. It is set up for fasttext. The card lists the license as mit.
This is the fastText pretraining data filter targeting the LAMBADA FR task, discussed in the main text of the Perplexity Correlations paper: https://arxiv.org/abs/2409.05816. This filter uses perplexity correlations t…
Downloads · 30 days
13
6% of all-time downloads
All-time downloads
217
Public
Repo size
3.9 GB
Likes
0
Public
Click a slice to open those files.
.bin3.9 GB · 100%
From the Hugging Face model README
This is the fastText pretraining data filter targeting the LAMBADA FR task, discussed in the main text of the Perplexity Correlations paper: https://arxiv.org/abs/2409.05816. This filter uses perplexity correlations to identify high-quality pretraining data without requiring any LLM training. It is designed to be used with the fastText library.
Github: https://github.com/TristanThrush/perplexity-correlations