medBert-512-caFT-final-shuffled

2ndBestKiller/medBert-512-caFT-final-shuffled

medBert-512-caFT-final-shuffled is a token classification model from 2ndBestKiller. Use it when you need labels on individual words, such as names. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

7% of all-time downloads

All-time downloads

Public

Parameters

108M

30.4 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors434 MB · 100%

At a glance

Task: Token Classification
Library: transformers
Model type: bert
Access: Public
Created: Jun 7, 2024
Updated: Jun 7, 2024
SHA: ef64a583

Try a prompt

Model card

From the Hugging Face model README

medbert-512

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.5292
Precision: 0.7859
Recall: 0.8252
F1: 0.8050
Accuracy: 0.9472

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 70

Training results

Training Loss	Epoch	Step	Validation Loss	Precision	Recall	F1	Accuracy
0.1947	1.0	2046	0.1846	0.7156	0.8028	0.7567	0.9431
0.1642	2.0	4092	0.1844	0.7298	0.8171	0.7710	0.9448
0.1348	3.0	6138	0.1859	0.7536	0.8097	0.7806	0.9461
0.1109	4.0	8184	0.1985	0.7574	0.8170	0.7861	0.9461
0.0875	5.0	10230	0.2242	0.7451	0.8117	0.7770	0.9453
0.081	6.0	12276	0.2446	0.7515	0.8059	0.7778	0.9445
0.0706	7.0	14322	0.2560	0.7559	0.8195	0.7864	0.9451
0.0619	8.0	16368	0.2591	0.7614	0.8188	0.7890	0.9460
0.0589	9.0	18414	0.2672	0.7683	0.8179	0.7924	0.9462
0.0533	10.0	20460	0.3028	0.7586	0.8178	0.7871	0.9438
0.0454	11.0	22506	0.3199	0.7641	0.8204	0.7912	0.9451
0.0453	12.0	24552	0.3401	0.7619	0.8122	0.7862	0.9450
0.044	13.0	26598	0.3341	0.7721	0.8171	0.7940	0.9444
0.0393	14.0	28644	0.3283	0.7663	0.8171	0.7909	0.9452
0.0365	15.0	30690	0.3766	0.7642	0.8208	0.7915	0.9453
0.0337	16.0	32736	0.3819	0.7569	0.8203	0.7873	0.9440
0.0352	17.0	34782	0.3761	0.7679	0.8201	0.7932	0.9459
0.0323	18.0	36828	0.3632	0.7639	0.8205	0.7912	0.9458
0.0305	19.0	38874	0.3939	0.7542	0.8208	0.7861	0.9455
0.029	20.0	40920	0.3937	0.7666	0.8171	0.7910	0.9455
0.0271	21.0	42966	0.3834	0.7702	0.8203	0.7945	0.9465
0.0283	22.0	45012	0.3798	0.7704	0.8223	0.7955	0.9461
0.028	23.0	47058	0.3902	0.7665	0.8203	0.7925	0.9467
0.0242	24.0	49104	0.3940	0.7746	0.8195	0.7964	0.9464
0.0284	25.0	51150	0.4423	0.7754	0.8163	0.7953	0.9448
0.0252	26.0	53196	0.4318	0.7763	0.8219	0.7984	0.9466
0.0236	27.0	55242	0.4379	0.7680	0.8233	0.7947	0.9448
0.0234	28.0	57288	0.4359	0.7720	0.8204	0.7955	0.9456
0.0231	29.0	59334	0.4527	0.7747	0.8169	0.7952	0.9452
0.02	30.0	61380	0.4508	0.7744	0.8192	0.7961	0.9450
0.0219	31.0	63426	0.4487	0.7713	0.8251	0.7973	0.9461
0.0218	32.0	65472	0.4512	0.7775	0.8169	0.7967	0.9458
0.0202	33.0	67518	0.4523	0.7751	0.8205	0.7972	0.9451
0.0212	34.0	69564	0.4705	0.7735	0.8233	0.7976	0.9455
0.0228	35.0	71610	0.4793	0.7694	0.8204	0.7941	0.9449
0.0195	36.0	73656	0.4502	0.7758	0.8208	0.7977	0.9452
0.0213	37.0	75702	0.4733	0.7798	0.8160	0.7975	0.9456
0.023	38.0	77748	0.4581	0.7786	0.8231	0.8003	0.9462
0.0193	39.0	79794	0.4651	0.7797	0.8189	0.7988	0.9455
0.0194	40.0	81840	0.4866	0.7775	0.8174	0.7970	0.9450
0.0202	41.0	83886	0.4732	0.7811	0.8211	0.8006	0.9453
0.0193	42.0	85932	0.4864	0.7812	0.8190	0.7997	0.9460
0.0178	43.0	87978	0.4862	0.7808	0.8184	0.7991	0.9457
0.0166	44.0	90024	0.4811	0.7753	0.8210	0.7974	0.9454
0.0193	45.0	92070	0.4859	0.7821	0.8164	0.7989	0.9456
0.0192	46.0	94116	0.5013	0.7754	0.8178	0.7960	0.9455
0.0163	47.0	96162	0.4912	0.7800	0.8151	0.7971	0.9456
0.019	48.0	98208	0.4786	0.7828	0.8177	0.7998	0.9460
0.0171	49.0	100254	0.4914	0.7809	0.8219	0.8009	0.9468
0.0166	50.0	102300	0.5041	0.7817	0.8248	0.8027	0.9460
0.0184	51.0	104346	0.5038	0.7839	0.8190	0.8011	0.9456
0.0178	52.0	106392	0.5020	0.7856	0.8220	0.8034	0.9467
0.0167	53.0	108438	0.4919	0.7837	0.8216	0.8022	0.9461
0.0168	54.0	110484	0.4908	0.7818	0.8231	0.8019	0.9465
0.0178	55.0	112530	0.5072	0.7847	0.8241	0.8039	0.9468
0.0151	56.0	114576	0.5233	0.7795	0.8231	0.8007	0.9460
0.0177	57.0	116622	0.5051	0.7799	0.8226	0.8007	0.9458
0.0176	58.0	118668	0.5149	0.7810	0.8215	0.8007	0.9455
0.0176	59.0	120714	0.5208	0.7821	0.8231	0.8021	0.9466
0.016	60.0	122760	0.5162	0.7824	0.8227	0.8021	0.9462
0.0146	61.0	124806	0.5166	0.7828	0.8215	0.8017	0.9470
0.015	62.0	126852	0.5185	0.7849	0.8227	0.8034	0.9466
0.0159	63.0	128898	0.5195	0.7838	0.8214	0.8022	0.9465
0.0162	64.0	130944	0.5267	0.7800	0.8260	0.8024	0.9469
0.0138	65.0	132990	0.5233	0.7818	0.8231	0.8019	0.9468
0.0165	66.0	135036	0.5246	0.7833	0.8245	0.8034	0.9471
0.0145	67.0	137082	0.5254	0.7870	0.8262	0.8061	0.9473
0.0157	68.0	139128	0.5271	0.7865	0.8262	0.8058	0.9474
0.0145	69.0	141174	0.5291	0.7853	0.8255	0.8049	0.9471
0.0152	70.0	143220	0.5292	0.7859	0.8252	0.8050	0.9472

Framework versions

Transformers 4.36.2
Pytorch 2.2.2
Datasets 2.18.0
Tokenizers 0.15.2

Task: Token Classification
Library: transformers
Type: bert
Created: Jun 7, 2024
Updated: Jun 7, 2024