Downloads · 30 days
7
3% of all-time downloads
Chord-Llama/Llama-3-chord-llama-fullModel
Llama-3-chord-llama-fullModel is a text generation model from Chord-Llama. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as apache-2.0.
Fintuned Llama for our music generation task.
Downloads · 30 days
7
3% of all-time downloads
All-time downloads
207
Public
Parameters
8B
16.1 GB on disk
Likes
0
Public
Click a slice to open those files.
.safetensors16.1 GB · 100%
From the Hugging Face model README
Fintuned Llama for our music generation task.
The tokenization of the model was not touched.
The model has three values, instruction, input and output.
Set the instruction to the simplified version of the “attributes” tag. This contains data like the tempo, and key that is kept throughout the entire length of the song.
The tokens in the instruction input are kept as important for the attention mechanism.
Finally, the existing portion of the song is put into the input, and the model then generates future tokens in the output
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.