Downloads · 30 days
8
10% of all-time downloads
MuseMistral-v3-35k
oof-baroomf/MuseMistral-v3-35k
MuseMistral-v3-35k is a machine learning model from oof-baroomf. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
should probably proofread and complete it, then remove this comment. --
All-time downloads
78
Public
Repo size
168 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors168 MB · 99%
At a glance
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Dec 24, 2023
- Updated
- Aug 6, 2024
- SHA
- 89e96b75
Base models
Model card
From the Hugging Face model README
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
should probably proofread and complete it, then remove this comment. -->
MuseMistral-v3-35k
This model is a fine-tuned version of mistralai/Mistral-7B-v0.1
Model description
This model generates classical music in ABC notation with only 7B parameters and internet data related to ABC notation.
Training procedure
Trained on free GPUs provided by Kaggle using Axolotl.
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0002
- train_batch_size: 1
- eval_batch_size: 8
- seed: 3407
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
- lr_scheduler_type: linear
- lr_scheduler_warmup_steps: 10
- training_steps: 1000
- mixed_precision_training: Native AMP
Framework versions
- PEFT 0.7.1
- Transformers 4.36.0
- Pytorch 2.1.2
- Datasets 2.16.0
- Tokenizers 0.15.0
- Library
- peft
- License
- apache-2.0
- Created
- Dec 24, 2023
- Updated
- Aug 6, 2024