Downloads · 30 days
79
0% of all-time downloads
pythia-70m-deduped-cleansharegpt-en
HWERI/pythia-70m-deduped-cleansharegpt-en
pythia-70m-deduped-cleansharegpt-en is a text generation model from HWERI. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Pythia-70m-deduped finetuned on a cleaned version of ShareGPT data. The cleaned dataset is obtained by removing duplicates and paraphrases from the original corpus, and keeping only the English instance. The final tra…
All-time downloads
64.3K
Public
Repo size
563 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin282 MB · 99%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- gpt_neox
- Access
- Public
- Created
- Sep 29, 2023
- Updated
- Nov 17, 2023
- SHA
- b150e596
Try a prompt
Datasets
Model card
From the Hugging Face model README
Pythia-70m-deduped finetuned on a cleaned version of ShareGPT data. The cleaned dataset is obtained by removing duplicates and paraphrases from the original corpus, and keeping only the English instance. The final training size is of 3507 instances.
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 25.06 |
| ARC (25-shot) | 21.16 |
| HellaSwag (10-shot) | 27.16 |
| MMLU (5-shot) | 25.24 |
| TruthfulQA (0-shot) | 48.57 |
| Winogrande (5-shot) | 50.12 |
| GSM8K (5-shot) | 0.0 |
| DROP (3-shot) | 3.15 |
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- License
- apache-2.0
- Languages
- en
- Created
- Sep 29, 2023
- Updated
- Nov 17, 2023