Downloads · 30 days
435
5% of all-time downloads
js-fakes-4bars
TristanBehrens/js-fakes-4bars
js-fakes-4bars is a text generation model from TristanBehrens. Use it when you need the model to write or continue text. It is set up for transformers.
Language Models such as GPT-2 can be used for Music Generation. The idea is to represent pieces of music as texts, effectively reducing the task to Language Generation.
All-time downloads
8.5K
Public
Repo size
197 MB
Likes
11
Public
Repo makeup
Click a slice to open those files.
.bin78.6 MB · 100%
At a glance
- Task
- Text Generation
- Library
- transformers
- Model type
- gpt2
- Access
- Public
- Created
- Mar 2, 2022
- Updated
- Mar 9, 2023
- SHA
- 7422747e
Try a prompt
Model card
From the Hugging Face model README
GPT-2 for Music
Language Models such as GPT-2 can be used for Music Generation. The idea is to represent pieces of music as texts, effectively reducing the task to Language Generation.
This model is a rather small instance of GPT-2 trained on TristanBehrens/js-fakes-4bars. The model generates 4 bars at a time of Bach-like chorales with four voices (soprano, alto, tenor, bass).
If you are contribute, if you want to say hello, if you want to know more, find me on LinkedIn
Model description
The model is GPT-2 with 6 decoders and 8 attention-heads each. The context length is 512. The embedding dimensions are 512 as well. The vocabulary size is 119.
Intended uses & limitations
This model is just a proof of concept. It shows that HuggingFace can be used to compose music.
How to use
There is a notebook in the repo that you can run on Google Colab.
Limitations and bias
Since this model has been trained on a very small corpus of music, it is overfitting heavily.
- Task
- Text Generation
- Library
- transformers
- Type
- gpt2
- Created
- Mar 2, 2022
- Updated
- Mar 9, 2023