Downloads · 30 days
0
chatbot_29_8
hoang14/chatbot_29_8
chatbot_29_8 is a machine learning model from hoang14. Use it for the machine learning task on the model card, and read the license before you ship it in a product.
ATASET = "task-focus + sample from remain datasets"
Access
Public
Updated Aug 30, 2023
Repo size
944 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin944 MB · 100%
At a glance
- Access
- Public
- Created
- Aug 29, 2023
- Updated
- Aug 30, 2023
- SHA
- 99cd2a12
Model card
From the Hugging Face model README
ATASET = "task-focus + sample from remain datasets"
DATASET_FORMAT = 'input-output'
PER_DEVICE_TRAIN_BATCH_SIZE = 2
GRADIENT_ACCUMULATION_STEPS = 4
LEARNING_RATE = 0.0003
LR_SCHEDULER_TYPE = 'cosine'
WARMUP_RATIO = 0.03
LORA_R = 192
LORA_ALPHA = 64
LORA_DROPOUT = 0.1
TRAIN_ON_SOURCE = False
SOURCE_MAX_LENGTH = 1024
TARGET_MAX_LENGTH = 1024
LOGGING_STEPS = 20
SAVE_STEPS = 100
SAVE_TOTAL_LIMIT = 4
- Created
- Aug 29, 2023
- Updated
- Aug 30, 2023