Downloads · 30 days
7
22% of all-time downloads
mayonek1
mayonek/mayonek1
mayonek1 is a machine learning model from mayonek. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for transformers.
torchrun --nprocpernode=1 --masterport=9778 fastchat/train/trainflant5.py \ --modelnameorpath lmsys/fastchat-t5-3b-v1.0 \ --datapath /workspace/processeddata.json \ --bf16 True \ --outputdir ./workspace/RYRMODEL \ --n…
All-time downloads
32
Public
Repo size
11.9 GB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin11.9 GB · 100%
At a glance
- Library
- transformers
- Model type
- t5
- Access
- Public
- Created
- Jun 14, 2023
- Updated
- Jun 14, 2023
- SHA
- 72151c69
Model card
From the Hugging Face model README
torchrun --nproc_per_node=1 --master_port=9778 fastchat/train/train_flant5.py
--model_name_or_path lmsys/fastchat-t5-3b-v1.0
--data_path /workspace/processed_data.json
--bf16 True
--output_dir ./workspace/RYRMODEL
--num_train_epochs 3
--per_device_train_batch_size 1
--per_device_eval_batch_size 1
--gradient_accumulation_steps 4
--evaluation_strategy "no"
--save_strategy "steps"
--save_steps 300
--save_total_limit 1
--learning_rate 2e-5
--weight_decay 0.
--warmup_ratio 0.03
--lr_scheduler_type "cosine"
--logging_steps 1
--fsdp "full_shard auto_wrap"
--fsdp_transformer_layer_cls_to_wrap T5Block
--tf32 True
--model_max_length 2048
--preprocessed_path ./preprocessed_data/processed.json
--gradient_checkpointing True
- Library
- transformers
- Type
- t5
- Created
- Jun 14, 2023
- Updated
- Jun 14, 2023