Downloads · 30 days
0
fasttext-oh-eli5
mlfoundations/fasttext-oh-eli5
fasttext-oh-eli5 is a machine learning model from mlfoundations. Use it for the machine learning task on the model card, and read the license before you ship it in a product. The card lists the license as mit.
Fasttext model used for filtering in DataComp-LM to produce DCLM-Baseline.
Access
Public
Updated Aug 1, 2024
Repo size
2.4 GB
Likes
31
Public
Repo makeup
Click a slice to open those files.
.bin2.4 GB · 100%
At a glance
- License
- mit
- Access
- Public
- Created
- Jun 18, 2024
- Updated
- Aug 1, 2024
- SHA
- cd8b714a
Model card
From the Hugging Face model README
Fasttext model used for filtering in DataComp-LM to produce DCLM-Baseline.
The model classifies between __label__hq and __label__cc which correspond to "high-quality" (i.e., OH2.5 and Reddit ELI5 data) and "low-quality" (i.e., web-crawled data from Common Crawl) respectively. We use the score given to __label__hq to filter our documents via a percentile-based threshold.
See our dclm repo for documentation about how we applied to to filter data in our experiments.
See fasttext documentation for general documentation on fasttext classifiers and how to use them with python.
- License
- mit
- Created
- Jun 18, 2024
- Updated
- Aug 1, 2024