distilbert-base-uncased-test2

Jethuestad/distilbert-base-uncased-test2

distilbert-base-uncased-test2 is a token classification model from Jethuestad. Use it when you need labels on individual words, such as names. It is set up for transformers. The card lists the license as apache-2.0.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

2% of all-time downloads

All-time downloads

386

Public

Repo size

531 MB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin266 MB · 100%

At a glance

Task: Token Classification
Library: transformers
License: apache-2.0
Model type: distilbert
Access: Public
Created: Aug 17, 2022
Updated: Aug 17, 2022
SHA: 8d8b7d1f

Try a prompt

Datasets

wnut_17

Model card

From the Hugging Face model README

distilbert-base-uncased-test2

This model is a fine-tuned version of distilbert-base-uncased on the wnut_17 dataset. It achieves the following results on the evaluation set:

Loss: 0.3055
Precision: 0.5278
Recall: 0.3957
F1: 0.4523
Accuracy: 0.9462

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 3

Training results

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Accuracy
No log	1.0	213	0.2889	0.5439	0.3503	0.4262	0.9453
No log	2.0	426	0.2938	0.5236	0.3800	0.4404	0.9457
0.0544	3.0	639	0.3055	0.5278	0.3957	0.4523	0.9462

Framework versions

Transformers 4.21.1
Pytorch 1.12.1+cu102
Datasets 2.4.0
Tokenizers 0.12.1

Task: Token Classification
Library: transformers
Type: distilbert
License: apache-2.0
Created: Aug 17, 2022
Updated: Aug 17, 2022