Downloads · 30 days
30
38% of all-time downloads
SpikeGPT-BookCorpus
ridger/SpikeGPT-BookCorpus
SpikeGPT-BookCorpus is a text generation model from ridger. Use it when you need the model to write or continue text. It is set up for rwkv. The card lists the license as bsd-2-clause.
SpikeGPT-BookCorpus is a L18-D768 SpikeGPT model trained on BookCorpus. See https://github.com/ridgerchu/SpikeGPT for details.
All-time downloads
78
Public
Repo size
738 MB
Likes
22
Public
Repo makeup
Click a slice to open those files.
.pth738 MB · 100%
At a glance
- Task
- Text Generation
- Library
- rwkv
- License
- bsd-2-clause
- Access
- Public
- Created
- Mar 1, 2023
- Updated
- Mar 8, 2023
- SHA
- 28d52794
Try a prompt
Datasets
Model card
From the Hugging Face model README
SpikeGPT-BookCorpus
Model Description
SpikeGPT-BookCorpus is a L18-D768 SpikeGPT model trained on BookCorpus. See https://github.com/ridgerchu/SpikeGPT for details.
ctx_len = 1024 n_layer = 18 n_embd = 768
- Task
- Text Generation
- Library
- rwkv
- License
- bsd-2-clause
- Languages
- en
- Created
- Mar 1, 2023
- Updated
- Mar 8, 2023