Downloads · 30 days
66
5% of all-time downloads
gpt-nyc
monsoon-nlp/gpt-nyc
gpt-nyc is a text generation model from monsoon-nlp. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.
GPT2-Medium fine-tuned on questions and responses from https://reddit.com/r/asknyc
All-time downloads
1.4K
Public
Parameters
381M
4.8 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin1.4 GB · 34%
Parameter types
How the weights are stored.
F32356M · 93%
Try a prompt
Model card
From the Hugging Face model README
GPT-NYC
About
GPT2-Medium fine-tuned on questions and responses from https://reddit.com/r/asknyc
2023 Update: try a larger model: monsoon-nlp/nyc-savvy-llama2-7b
I filtered comments to ones with scores >= 3, and responding directly to the original post ( = ignoring responses to other commenters).
I added tokens to match NYC neighborhoods, subway stations, foods, and other common terms in the original batches of questions and comments. You would be surprised what is missing from GPT tokens!
Try prompting with question? %% or question? - more info %%
Status
I would like to continue by:
- fine-tuning GPT2-Large with a larger dataset of questions
- examining bias and toxicity
- examining memorization vs. original responses
- releasing a reusable benchmark
Blog
https://mapmeld.medium.com/gpt-nyc-part-1-9cb698b2e3d
Notebooks
Data processing / new tokens
https://colab.research.google.com/drive/13BOw0uekoAYB4jjQtaXTn6J_VHatiRLu
Fine-tuning GPT2 (small)
https://colab.research.google.com/drive/1FnXcAh4H-k8dAzixkV5ieygV96ePh3lR
Fine-tuning GPT2-Medium
Same code as small, but on Google Cloud to use an A100 GPU
Predictive text and probabilities
Scroll to end of
https://colab.research.google.com/drive/1FnXcAh4H-k8dAzixkV5ieygV96ePh3lR
to see how to install git-lfs and trick ecco into loading this.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- License
- mit
- Languages
- en
- Created
- Mar 2, 2022
- Updated
- Sep 3, 2023