Downloads · 30 days
38
8% of all-time downloads
MPT-7b_Storywriter-Pythia_ChatBase-Merge
TehVenom/MPT-7b_Storywriter-Pythia_ChatBase-Merge
MPT-7b_Storywriter-Pythia_ChatBase-Merge is a text generation model from TehVenom. Use it when you need the model to write or continue text. It is set up for transformers.
The models have been hacked together because their base weights share a similar architecture. But for now using the Pythia inference code only gibberish is generated, while when trying to use the MPT based inference c…
All-time downloads
453
Public
Repo size
27.7 GB
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin13.8 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt_neox
- Access
- Public
- Created
- May 8, 2023
- Updated
- May 10, 2023
- SHA
- 05235ba9
Try a prompt
Model card
From the Hugging Face model README
The models have been hacked together because their base weights share a similar architecture. But for now using the Pythia inference code only gibberish is generated, while when trying to use the MPT based inference code, i am running into errors that stop it from working.
Currently trying to adapt the "MPT-7b Storywriter 65k" based inference code to work with this new model merge. I'd appreciate tips if anyone tries their hand at it.
This model is not functional as is.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt_neox
- Created
- May 8, 2023
- Updated
- May 10, 2023