Downloads · 30 days
22
4% of all-time downloads
gpt-j-8bit-KILT_WoW_10k_steps
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
gpt-j-8bit-KILT_WoW_10k_steps is a text generation model from ethzanalytics. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<a href="https://colab.research.google.com/gist/pszemraj/e49c60aafe04acc52fcfdd1baefe12e4/-ai-msgbot-gpt-j-6b-8bit-with-hub.ipynb" <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab…
All-time downloads
585
Public
Repo size
18.6 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin6.2 GB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- License
- apache-2.0
- Model type
- gptj
- Access
- Public
- Created
- Nov 27, 2022
- Updated
- Nov 27, 2022
- SHA
- f0539047
Try a prompt
Datasets
Model card
From the Hugging Face model README
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
<a href="https://colab.research.google.com/gist/pszemraj/e49c60aafe04acc52fcfdd1baefe12e4/-ai-msgbot-gpt-j-6b-8bit-with-hub.ipynb"> <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/> </a>This is a version of hivemind/gpt-j-6B-8bit fine-tuned on the Wizard of Wikipedia dataset for 10k steps (just under an epoch) on an A100. it can be used as a chatbot. It is designed to be used with ai-msgbot to take advantage of the prompt engineering.
Usage
NOTE: this needs to be loaded via the special patching technique outlined in the hivemind model card (as with all 8bit models)
Examples of how to load the model correctly are already in place in the notebook linked above. A .py of said notebook was uploaded to the repo for reference - link here
Training
For details, please see this wandb report for both the daily-dialogues version and the WoW version.
- Task
- Text Generation
- Library
- transformers
- Type
- gptj
- License
- apache-2.0
- Created
- Nov 27, 2022
- Updated
- Nov 27, 2022