Downloads · 30 days
10
0% of all-time downloads
chemberta-v2-finetuned-uspto-50k-classification
pingzhili/chemberta-v2-finetuned-uspto-50k-classification
chemberta-v2-finetuned-uspto-50k-classification is a text classification model from pingzhili. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as mit.
This ChemBERTa-v2 checkpoint was fine-tuned on the USPTO-50k dataset for sequence classification.
All-time downloads
2.4K
Public
Parameters
83.5M
334 MB on disk
Likes
4
Public
Repo makeup
Click a slice to open those files.
.safetensors334 MB · 100%
At a glance
- Task
- Text Classification
- Library
- transformers
- License
- mit
- Model type
- roberta
- Access
- Public
- Created
- Nov 12, 2023
- Updated
- Nov 12, 2023
- SHA
- 2d865376
Try a prompt
Datasets
Model card
From the Hugging Face model README
This ChemBERTa-v2 checkpoint was fine-tuned on the USPTO-50k dataset for sequence classification.
Specifically, the objective is to predict the reaction class label, and the input is either (canonicalized) all reactant SMILES or all product SMILES (separated by ".").
-
Train/Test split: 0.99/0.01
-
Evaluation results:
- Accuracy: 87.11%
- Loss: 0.4272
-
Fine-tuning hyperparameters:
- seed = 233
- batch-size = 128
- num_epochs = 5 (but early stopped at epoch 4)
- learning_rate = 5e-4
- warmup_steps = 64
- weight_decay = 0.01
- lr_scheduler_type = "cosine"
- Task
- Text Classification
- Library
- transformers
- Type
- roberta
- License
- mit
- Created
- Nov 12, 2023
- Updated
- Nov 12, 2023