Downloads · 30 days
15
17% of all-time downloads
horizon-pythia-ft-1.4b
crumb/horizon-pythia-ft-1.4b
horizon-pythia-ft-1.4b is a text generation model from crumb. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
All-time downloads
89
Public
Repo size
11.3 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin5.7 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- gpt_neox
- Access
- Public
- Created
- Nov 13, 2023
- Updated
- Nov 13, 2023
- SHA
- 3b09abad
Try a prompt
Model card
From the Hugging Face model README
validation loss
| model | arxiv | github | books | wiki | webtext |
|---|---|---|---|---|---|
| horizon-pythia-ft-1.4b | 2.05 | 1.23 | 1.90 | 2.12 | 2.61 |
| pythia-1.4b | 2.13 | 1.25 | 1.91 | 2.18 | 2.62 |
horizon-derived reweighting media (mix-13)
| subset | documents |
|---|---|
| arxiv | 650 |
| github | 229 |
| books | 645 |
| wiki | 1560 |
| webtext | 10440 |
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- License
- apache-2.0
- Languages
- en
- Created
- Nov 13, 2023
- Updated
- Nov 13, 2023