Downloads · 30 days
48
6% of all-time downloads
gpt-j-8bit-daily_dialogues
ethzanalytics/gpt-j-8bit-daily_dialogues
gpt-j-8bit-daily_dialogues is a text generation model from ethzanalytics. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
<a href="https://colab.research.google.com/gist/pszemraj/e49c60aafe04acc52fcfdd1baefe12e4/-ai-msgbot-gpt-j-6b-8bit-with-hub.ipynb" <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab…
All-time downloads
848
Public
Parameters
6.2B
18.6 GB on disk
Likes
5
Public
Repo makeup
Click a slice to open those files.
.bin6.2 GB · 50%
Parameter types
How the weights are stored.
U86.2B · 100%
Try a prompt
Datasets
Model card
From the Hugging Face model README
ethzanalytics/gpt-j-8bit-daily_dialogues
<a href="https://colab.research.google.com/gist/pszemraj/e49c60aafe04acc52fcfdd1baefe12e4/-ai-msgbot-gpt-j-6b-8bit-with-hub.ipynb"> <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/> </a>This version of hivemind/gpt-j-6B-8bit is fine-tuned on a parsed version of the daily dialogues dataset for an epoch. It can be used as a chatbot.
It is designed to be used with ai-msgbot to take advantage of prompt engineering in fine-tuning.
Usage
NOTE: this needs to be loaded via the special patching technique outlined in the hivemind model card (as with all 8bit models)
Examples of how to load the model correctly are already in place in the notebook linked above. A .py of said notebook was uploaded to the repo for reference - link here
Training
For details, please see this wandb report for both the daily-dialogues version and the WoW version.
- Task
- Text Generation
- Library
- transformers
- Type
- gptj
- License
- apache-2.0
- Created
- Nov 27, 2022
- Updated
- Dec 25, 2024