Downloads · 30 days
8
40% of all-time downloads
demo1_protrek
lxzcpro/demo1_protrek
demo1_protrek is a machine learning model from lxzcpro. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
This model is used for a demo regression task
All-time downloads
20
Public
Repo size
8.2 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors4.3 MB · 52%
At a glance
- Library
- peft
- Access
- Public
- Created
- Sep 4, 2024
- Updated
- Sep 4, 2024
- SHA
- 2d2302dd
Base models
Model card
From the Hugging Face model README
Model Card for Model-demo-35M
This model is used for a demo regression task
Task type
Protein-level Regression
Model input type
AA Sequence
Label meanings
None
LoRA config
- r: 8
- lora_dropout: 0.0
- lora_alpha: 16
- target_modules: ['output.dense', 'key', 'value', 'query', 'intermediate.dense']
- modules_to_save: ['classifier']
Training config
- optimizer:
- class: AdamW
- betas: (0.9, 0.98)
- weight_decay: 0.01
- learning rate: 0.001
- epoch: 10
- batch size: 2
- precision: 16-mixed
- Library
- peft
- Created
- Sep 4, 2024
- Updated
- Sep 4, 2024