Downloads · 30 days
21
3% of all-time downloads
scibert-scivocab-cased_pub_section
ml4pubmed/scibert-scivocab-cased_pub_section
scibert-scivocab-cased_pub_section is a text classification model from ml4pubmed. Use it when you need a label for a piece of text. It is set up for transformers.
- original model file name: textclassiferscibertscivocabcasedpubmed20k - This is a fine-tuned checkpoint of allenai/scibertscivocabcased for document section text classification - possible document section classes are…
All-time downloads
799
Public
Parameters
110M
1.8 GB on disk
Likes
1
Public
Repo makeup
Click a slice to open those files.
.bin440 MB · 50%
Parameter types
How the weights are stored.
F32110M · 100%
Try a prompt
Datasets
Model card
From the Hugging Face model README
scibert-scivocab-cased_pub_section
- original model file name: textclassifer_scibert_scivocab_cased_pubmed_20k
- This is a fine-tuned checkpoint of
allenai/scibert_scivocab_casedfor document section text classification - possible document section classes are:BACKGROUND, CONCLUSIONS, METHODS, OBJECTIVE, RESULTS,
metadata
training_metrics
-
date_run: Apr-26-2022_t-13
-
huggingface_tag: allenai/scibert_scivocab_cased
-
test_set: [{'test_accuracy': 0.8313589096069336, 'test_matthewscorrcoef': 0.7736952900886536, 'test_f1score': 0.8317078948020935, 'test_cross_entropy': 0.5242752432823181}]
training_parameters
-
NUM_EPOCHS: 12
-
BATCH_SIZE: 32
-
MAX_INPUT_LENGTH: 256
-
TRAIN_FP16: True
-
TRAIN_STRATEGY: freeze
-
LR_SCHEDULE: reducelronplateau
-
LR_INITIAL: 0.001
-
WEIGHT_DECAY: 0.05
-
UNFREEZE_EPOCH: 4
-
hf_tag: allenai/scibert_scivocab_cased
-
lowercased_input: False
-
input_text_colname: description
-
target_cls_colname: target
-
num_classes: 5
-
model_shortname: scibert_scivocab_cased
- Task
- Text Classification
- Library
- transformers
- Type
- bert
- Languages
- en
- Created
- May 3, 2022
- Updated
- Mar 20, 2023