Downloads · 30 days
3
11% of all-time downloads
HW2
jimboHsueh/HW2
HW2 is a machine learning model from jimboHsueh. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
Download training and validation data, as well as fine-tuned mT5 model.
All-time downloads
27
Public
Repo size
8.4 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin1.2 GB · 98%
At a glance
- Library
- transformers
- Model type
- mt5
- Access
- Public
- Created
- Oct 20, 2023
- Updated
- Nov 7, 2023
- SHA
- abcf9602
Spaces
Model card
From the Hugging Face model README
HW2
Environment
pip install -r requirements.txt
Download
Download training and validation data, as well as fine-tuned mT5 model.
bash ./download.sh
Fine tuning mT5 model
python ./code/run_summarization.py \
--model_name_or_path google/mt5-small \
--train_file train.jsonl \
--validation_file public.jsonl \
--dataset_config "3.0.0" \
--source_prefix "summarize: " \
--output_dir ./HW2 \
--num_train_epochs 3 \
--num_beams 1 \
--do_sample False \
--push_to_hub
-model_name_or_path: Path to pretrained model.
-output_dir: Path to directory which saves the model outputs.
-train_file: Path to train.jsonl.
-validation_file: Path to public.jsonl.
Generate output.jsonl
bash ./download.sh
bash ./run.sh /path/to/input.jsonl /path/to/output.jsonl
- Library
- transformers
- Type
- mt5
- Created
- Oct 20, 2023
- Updated
- Nov 7, 2023