tapt_reinit_only_5K_with_reinit_classifier_llrd0.9-LR_2e-05

Mardiyyah/tapt_reinit_only_5K_with_reinit_classifier_llrd0.9-LR_2e-05

tapt_reinit_only_5K_with_reinit_classifier_llrd0.9-LR_2e-05 is a fill-mask model from Mardiyyah. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

9% of all-time downloads

All-time downloads

Public

Parameters

110M

438 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors438 MB · 100%

At a glance

Task: Fill-Mask
Library: transformers
License: mit
Model type: bert
Access: Public
Created: Nov 18, 2025
Updated: Nov 18, 2025
SHA: 82636860

Try a prompt

Base models

microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext

Model card

From the Hugging Face model README

tapt_reinit_only_5K_with_reinit_classifier_llrd0.9-LR_2e-05

This model is a fine-tuned version of microsoft/BiomedNLP-BiomedBERT-base-uncased-abstract-fulltext on the Mardiyyah/TAPT-PDBE-V1 dataset. It achieves the following results on the evaluation set:

Loss: 1.8286

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 16
eval_batch_size: 16
seed: 3407
gradient_accumulation_steps: 4
total_train_batch_size: 64
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-06 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
lr_scheduler_warmup_ratio: 0.06
num_epochs: 50
mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss
No log	0.0864	10	1.7821
No log	0.1728	20	1.7963
No log	0.2592	30	1.8145
No log	0.3456	40	1.7323
No log	0.4320	50	1.7571
No log	0.5184	60	1.7650
No log	0.6048	70	1.7096
No log	0.6911	80	1.7274
No log	0.7775	90	1.6812
No log	0.8639	100	1.6850
No log	0.9503	110	1.7034
1.765	1.0346	120	1.7217
1.765	1.1210	130	1.6991
1.765	1.2073	140	1.7116
1.765	1.2937	150	1.6715
1.765	1.3801	160	1.6420
1.765	1.4665	170	1.6709
1.765	1.5529	180	1.7283
1.765	1.6393	190	1.7047
1.765	1.7257	200	1.6390
1.765	1.8121	210	1.6676
1.765	1.8985	220	1.6790
1.765	1.9849	230	1.7122
1.6783	2.0691	240	1.6675
1.6783	2.1555	250	1.6320
1.6783	2.2419	260	1.6869
1.6783	2.3283	270	1.6954
1.6783	2.4147	280	1.6793
1.6783	2.5011	290	1.6940
1.6783	2.5875	300	1.6769
1.6783	2.6739	310	1.6993
1.6783	2.7603	320	1.6979
1.6783	2.8467	330	1.6958
1.6783	2.9330	340	1.7220
1.6278	3.0173	350	1.6986
1.6278	3.1037	360	1.7005
1.6278	3.1901	370	1.6716
1.6278	3.2765	380	1.6955
1.6278	3.3629	390	1.6817
1.6278	3.4492	400	1.7091
1.6278	3.5356	410	1.6879
1.6278	3.6220	420	1.7283
1.6278	3.7084	430	1.6899
1.6278	3.7948	440	1.6915
1.6278	3.8812	450	1.7287
1.6278	3.9676	460	1.7127
1.5836	4.0518	470	1.6941
1.5836	4.1382	480	1.6880
1.5836	4.2246	490	1.7316
1.5836	4.3110	500	1.7339
1.5836	4.3974	510	1.7274
1.5836	4.4838	520	1.6582
1.5836	4.5702	530	1.6987
1.5836	4.6566	540	1.7182
1.5836	4.7430	550	1.7155
1.5836	4.8294	560	1.7201
1.5836	4.9158	570	1.6879
1.5836	5.0	580	1.6399
1.5378	5.0864	590	1.6675
1.5378	5.1728	600	1.6780
1.5378	5.2592	610	1.6472
1.5378	5.3456	620	1.6996
1.5378	5.4320	630	1.6973
1.5378	5.5184	640	1.6949
1.5378	5.6048	650	1.6884
1.5378	5.6911	660	1.6889
1.5378	5.7775	670	1.7003
1.5378	5.8639	680	1.6865
1.5378	5.9503	690	1.7242
1.4875	6.0346	700	1.6996
1.4875	6.1210	710	1.7653
1.4875	6.2073	720	1.6788
1.4875	6.2937	730	1.7240
1.4875	6.3801	740	1.7446
1.4875	6.4665	750	1.7529
1.4875	6.5529	760	1.6966
1.4875	6.6393	770	1.7888
1.4875	6.7257	780	1.7387
1.4875	6.8121	790	1.7283
1.4875	6.8985	800	1.7328
1.4875	6.9849	810	1.6943
1.4431	7.0691	820	1.7067
1.4431	7.1555	830	1.7446
1.4431	7.2419	840	1.7108
1.4431	7.3283	850	1.7438
1.4431	7.4147	860	1.7423
1.4431	7.5011	870	1.7526
1.4431	7.5875	880	1.7670
1.4431	7.6739	890	1.6962
1.4431	7.7603	900	1.7065
1.4431	7.8467	910	1.7226
1.4431	7.9330	920	1.7181
1.4232	8.0173	930	1.7431
1.4232	8.1037	940	1.7123
1.4232	8.1901	950	1.7022
1.4232	8.2765	960	1.7132
1.4232	8.3629	970	1.7056
1.4232	8.4492	980	1.7583
1.4232	8.5356	990	1.7219
1.4232	8.6220	1000	1.7866
1.4232	8.7084	1010	1.7552
1.4232	8.7948	1020	1.7073
1.4232	8.8812	1030	1.7241
1.4232	8.9676	1040	1.7384
1.4037	9.0518	1050	1.7443
1.4037	9.1382	1060	1.7018
1.4037	9.2246	1070	1.7506
1.4037	9.3110	1080	1.7356
1.4037	9.3974	1090	1.7693
1.4037	9.4838	1100	1.7510
1.4037	9.5702	1110	1.7829
1.4037	9.6566	1120	1.7063
1.4037	9.7430	1130	1.6873
1.4037	9.8294	1140	1.7587
1.4037	9.9158	1150	1.7368
1.4037	10.0	1160	1.7341
1.3663	10.0864	1170	1.7189
1.3663	10.1728	1180	1.6961
1.3663	10.2592	1190	1.7188
1.3663	10.3456	1200	1.7164
1.3663	10.4320	1210	1.7387
1.3663	10.5184	1220	1.7781
1.3663	10.6048	1230	1.7414
1.3663	10.6911	1240	1.7228
1.3663	10.7775	1250	1.7346
1.3663	10.8639	1260	1.7245
1.3663	10.9503	1270	1.7685
1.3709	11.0346	1280	1.7927
1.3709	11.1210	1290	1.7437
1.3709	11.2073	1300	1.7310
1.3709	11.2937	1310	1.8042
1.3709	11.3801	1320	1.7054
1.3709	11.4665	1330	1.7572
1.3709	11.5529	1340	1.7528
1.3709	11.6393	1350	1.7373
1.3709	11.7257	1360	1.7547
1.3709	11.8121	1370	1.7795
1.3709	11.8985	1380	1.7446
1.3709	11.9849	1390	1.7811
1.3513	12.0691	1400	1.7526
1.3513	12.1555	1410	1.7839
1.3513	12.2419	1420	1.7509
1.3513	12.3283	1430	1.8093
1.3513	12.4147	1440	1.7510
1.3513	12.5011	1450	1.7460
1.3513	12.5875	1460	1.7962
1.3513	12.6739	1470	1.7825
1.3513	12.7603	1480	1.7216
1.3513	12.8467	1490	1.7259
1.3513	12.9330	1500	1.7686
1.3474	13.0173	1510	1.7690
1.3474	13.1037	1520	1.7884
1.3474	13.1901	1530	1.7634
1.3474	13.2765	1540	1.7968
1.3474	13.3629	1550	1.8037
1.3474	13.4492	1560	1.7373
1.3474	13.5356	1570	1.8101
1.3474	13.6220	1580	1.7705
1.3474	13.7084	1590	1.8047
1.3474	13.7948	1600	1.7937
1.3474	13.8812	1610	1.7880
1.3474	13.9676	1620	1.7411
1.3098	14.0518	1630	1.8130
1.3098	14.1382	1640	1.7722
1.3098	14.2246	1650	1.7541
1.3098	14.3110	1660	1.7135
1.3098	14.3974	1670	1.7498
1.3098	14.4838	1680	1.7723
1.3098	14.5702	1690	1.7145
1.3098	14.6566	1700	1.6909
1.3098	14.7430	1710	1.7902
1.3098	14.8294	1720	1.8279
1.3098	14.9158	1730	1.7901
1.3098	15.0	1740	1.7162
1.2968	15.0864	1750	1.7317
1.2968	15.1728	1760	1.7523
1.2968	15.2592	1770	1.8102
1.2968	15.3456	1780	1.7927
1.2968	15.4320	1790	1.7543
1.2968	15.5184	1800	1.7856
1.2968	15.6048	1810	1.8249
1.2968	15.6911	1820	1.7609
1.2968	15.7775	1830	1.7307
1.2968	15.8639	1840	1.7643
1.2968	15.9503	1850	1.7570
1.2574	16.0346	1860	1.8150
1.2574	16.1210	1870	1.8331
1.2574	16.2073	1880	1.7555
1.2574	16.2937	1890	1.7632
1.2574	16.3801	1900	1.7387
1.2574	16.4665	1910	1.7764
1.2574	16.5529	1920	1.7578
1.2574	16.6393	1930	1.7834
1.2574	16.7257	1940	1.8033
1.2574	16.8121	1950	1.7403
1.2574	16.8985	1960	1.7536
1.2574	16.9849	1970	1.7435
1.2498	17.0691	1980	1.7715
1.2498	17.1555	1990	1.7943
1.2498	17.2419	2000	1.7364
1.2498	17.3283	2010	1.8045
1.2498	17.4147	2020	1.7873
1.2498	17.5011	2030	1.7775
1.2498	17.5875	2040	1.8009
1.2498	17.6739	2050	1.7594
1.2498	17.7603	2060	1.7592
1.2498	17.8467	2070	1.7949
1.2498	17.9330	2080	1.7661
1.2298	18.0173	2090	1.7412
1.2298	18.1037	2100	1.7670
1.2298	18.1901	2110	1.8000
1.2298	18.2765	2120	1.7467
1.2298	18.3629	2130	1.7857
1.2298	18.4492	2140	1.8083
1.2298	18.5356	2150	1.7703
1.2298	18.6220	2160	1.7919
1.2298	18.7084	2170	1.8014
1.2298	18.7948	2180	1.7779
1.2298	18.8812	2190	1.7681
1.2298	18.9676	2200	1.7854
1.2511	19.0518	2210	1.8033
1.2511	19.1382	2220	1.8037
1.2511	19.2246	2230	1.8565
1.2511	19.3110	2240	1.8291
1.2511	19.3974	2250	1.8273
1.2511	19.4838	2260	1.7570
1.2511	19.5702	2270	1.7601
1.2511	19.6566	2280	1.8349
1.2511	19.7430	2290	1.8163
1.2511	19.8294	2300	1.7653
1.2511	19.9158	2310	1.7619
1.2511	20.0	2320	1.8069
1.2083	20.0864	2330	1.8024
1.2083	20.1728	2340	1.7673
1.2083	20.2592	2350	1.7669
1.2083	20.3456	2360	1.8505
1.2083	20.4320	2370	1.7959
1.2083	20.5184	2380	1.8064
1.2083	20.6048	2390	1.8227
1.2083	20.6911	2400	1.8101
1.2083	20.7775	2410	1.7758
1.2083	20.8639	2420	1.8187
1.2083	20.9503	2430	1.8017
1.2297	21.0346	2440	1.7516
1.2297	21.1210	2450	1.7663
1.2297	21.2073	2460	1.7674
1.2297	21.2937	2470	1.8123
1.2297	21.3801	2480	1.7895
1.2297	21.4665	2490	1.7790
1.2297	21.5529	2500	1.8210
1.2297	21.6393	2510	1.8011
1.2297	21.7257	2520	1.8026
1.2297	21.8121	2530	1.7900
1.2297	21.8985	2540	1.7898
1.2297	21.9849	2550	1.8195
1.1938	22.0691	2560	1.7919
1.1938	22.1555	2570	1.8421
1.1938	22.2419	2580	1.8317
1.1938	22.3283	2590	1.8417
1.1938	22.4147	2600	1.7953
1.1938	22.5011	2610	1.8435
1.1938	22.5875	2620	1.8043
1.1938	22.6739	2630	1.8005
1.1938	22.7603	2640	1.7582
1.1938	22.8467	2650	1.8242
1.1938	22.9330	2660	1.7455
1.1886	23.0173	2670	1.7367
1.1886	23.1037	2680	1.8234
1.1886	23.1901	2690	1.7472
1.1886	23.2765	2700	1.7885
1.1886	23.3629	2710	1.8452
1.1886	23.4492	2720	1.8419
1.1886	23.5356	2730	1.8299
1.1886	23.6220	2740	1.8227
1.1886	23.7084	2750	1.8148
1.1886	23.7948	2760	1.7903
1.1886	23.8812	2770	1.8130
1.1886	23.9676	2780	1.7481
1.1826	24.0518	2790	1.7989
1.1826	24.1382	2800	1.7807
1.1826	24.2246	2810	1.8221
1.1826	24.3110	2820	1.8326
1.1826	24.3974	2830	1.8006
1.1826	24.4838	2840	1.8592
1.1826	24.5702	2850	1.8025
1.1826	24.6566	2860	1.8153
1.1826	24.7430	2870	1.7686
1.1826	24.8294	2880	1.7994
1.1826	24.9158	2890	1.8222
1.1826	25.0	2900	1.8511
1.171	25.0864	2910	1.8098
1.171	25.1728	2920	1.7922
1.171	25.2592	2930	1.8313
1.171	25.3456	2940	1.8158
1.171	25.4320	2950	1.7944
1.171	25.5184	2960	1.8492
1.171	25.6048	2970	1.8299
1.171	25.6911	2980	1.7854
1.171	25.7775	2990	1.7870
1.171	25.8639	3000	1.8433
1.171	25.9503	3010	1.8225
1.1514	26.0346	3020	1.8100
1.1514	26.1210	3030	1.8224
1.1514	26.2073	3040	1.8383
1.1514	26.2937	3050	1.7882
1.1514	26.3801	3060	1.9022
1.1514	26.4665	3070	1.8037
1.1514	26.5529	3080	1.8544
1.1514	26.6393	3090	1.7971
1.1514	26.7257	3100	1.7478
1.1514	26.8121	3110	1.8241
1.1514	26.8985	3120	1.8110
1.1514	26.9849	3130	1.7842
1.1847	27.0691	3140	1.7727
1.1847	27.1555	3150	1.8155
1.1847	27.2419	3160	1.8168
1.1847	27.3283	3170	1.8128
1.1847	27.4147	3180	1.8228
1.1847	27.5011	3190	1.8238
1.1847	27.5875	3200	1.7844
1.1847	27.6739	3210	1.8502
1.1847	27.7603	3220	1.8042
1.1847	27.8467	3230	1.7943
1.1847	27.9330	3240	1.7888
1.1631	28.0173	3250	1.7835
1.1631	28.1037	3260	1.7985
1.1631	28.1901	3270	1.7573
1.1631	28.2765	3280	1.7694
1.1631	28.3629	3290	1.8301
1.1631	28.4492	3300	1.8520
1.1631	28.5356	3310	1.7963
1.1631	28.6220	3320	1.8157
1.1631	28.7084	3330	1.8411
1.1631	28.7948	3340	1.7853
1.1631	28.8812	3350	1.7949
1.1631	28.9676	3360	1.8044
1.1477	29.0518	3370	1.7879
1.1477	29.1382	3380	1.7829
1.1477	29.2246	3390	1.8222
1.1477	29.3110	3400	1.8102
1.1477	29.3974	3410	1.8120
1.1477	29.4838	3420	1.8227
1.1477	29.5702	3430	1.8424
1.1477	29.6566	3440	1.7705
1.1477	29.7430	3450	1.7619
1.1477	29.8294	3460	1.8175
1.1477	29.9158	3470	1.8141
1.1477	30.0	3480	1.8172
1.1135	30.0864	3490	1.8708
1.1135	30.1728	3500	1.8092
1.1135	30.2592	3510	1.7913
1.1135	30.3456	3520	1.8722
1.1135	30.4320	3530	1.8157
1.1135	30.5184	3540	1.7857
1.1135	30.6048	3550	1.8559
1.1135	30.6911	3560	1.7780
1.1135	30.7775	3570	1.8201
1.1135	30.8639	3580	1.7944
1.1135	30.9503	3590	1.8395
1.1443	31.0346	3600	1.7944
1.1443	31.1210	3610	1.8557
1.1443	31.2073	3620	1.7938
1.1443	31.2937	3630	1.8195
1.1443	31.3801	3640	1.8240
1.1443	31.4665	3650	1.8436
1.1443	31.5529	3660	1.7971
1.1443	31.6393	3670	1.7990
1.1443	31.7257	3680	1.8405
1.1443	31.8121	3690	1.8260
1.1443	31.8985	3700	1.8003
1.1443	31.9849	3710	1.8854
1.134	32.0691	3720	1.8438
1.134	32.1555	3730	1.8556
1.134	32.2419	3740	1.8338
1.134	32.3283	3750	1.8106
1.134	32.4147	3760	1.8534
1.134	32.5011	3770	1.8440
1.134	32.5875	3780	1.8221
1.134	32.6739	3790	1.8420
1.134	32.7603	3800	1.7948
1.134	32.8467	3810	1.8220
1.134	32.9330	3820	1.8570
1.1092	33.0173	3830	1.8762
1.1092	33.1037	3840	1.8499
1.1092	33.1901	3850	1.8351
1.1092	33.2765	3860	1.8249
1.1092	33.3629	3870	1.7743
1.1092	33.4492	3880	1.8669
1.1092	33.5356	3890	1.8845
1.1092	33.6220	3900	1.8266
1.1092	33.7084	3910	1.8306
1.1092	33.7948	3920	1.7967
1.1092	33.8812	3930	1.8335
1.1092	33.9676	3940	1.8442
1.1324	34.0518	3950	1.8277
1.1324	34.1382	3960	1.8629
1.1324	34.2246	3970	1.8404
1.1324	34.3110	3980	1.8878
1.1324	34.3974	3990	1.8598
1.1324	34.4838	4000	1.8378
1.1324	34.5702	4010	1.8709
1.1324	34.6566	4020	1.7906
1.1324	34.7430	4030	1.8023
1.1324	34.8294	4040	1.8664
1.1324	34.9158	4050	1.8336
1.1324	35.0	4060	1.8568
1.1406	35.0864	4070	1.8429
1.1406	35.1728	4080	1.8432
1.1406	35.2592	4090	1.8661
1.1406	35.3456	4100	1.8542
1.1406	35.4320	4110	1.8299
1.1406	35.5184	4120	1.8756
1.1406	35.6048	4130	1.8368
1.1406	35.6911	4140	1.8400
1.1406	35.7775	4150	1.8259
1.1406	35.8639	4160	1.8477
1.1406	35.9503	4170	1.8222
1.1356	36.0346	4180	1.8633
1.1356	36.1210	4190	1.8389
1.1356	36.2073	4200	1.8192
1.1356	36.2937	4210	1.8224
1.1356	36.3801	4220	1.8477
1.1356	36.4665	4230	1.8381
1.1356	36.5529	4240	1.8326
1.1356	36.6393	4250	1.7906
1.1356	36.7257	4260	1.8319
1.1356	36.8121	4270	1.8007
1.1356	36.8985	4280	1.8387
1.1356	36.9849	4290	1.7991
1.1102	37.0691	4300	1.8268
1.1102	37.1555	4310	1.8783
1.1102	37.2419	4320	1.8232
1.1102	37.3283	4330	1.8375
1.1102	37.4147	4340	1.7846
1.1102	37.5011	4350	1.8400
1.1102	37.5875	4360	1.8667
1.1102	37.6739	4370	1.8576
1.1102	37.7603	4380	1.7848
1.1102	37.8467	4390	1.7930
1.1102	37.9330	4400	1.8686
1.1029	38.0173	4410	1.8383
1.1029	38.1037	4420	1.8341
1.1029	38.1901	4430	1.8611
1.1029	38.2765	4440	1.8539
1.1029	38.3629	4450	1.8401
1.1029	38.4492	4460	1.8450
1.1029	38.5356	4470	1.8004
1.1029	38.6220	4480	1.8306
1.1029	38.7084	4490	1.8570
1.1029	38.7948	4500	1.8335
1.1029	38.8812	4510	1.8166
1.1029	38.9676	4520	1.8402
1.094	39.0518	4530	1.8607
1.094	39.1382	4540	1.8161
1.094	39.2246	4550	1.8555
1.094	39.3110	4560	1.8403
1.094	39.3974	4570	1.8776
1.094	39.4838	4580	1.8269
1.094	39.5702	4590	1.8133
1.094	39.6566	4600	1.8414
1.094	39.7430	4610	1.8567
1.094	39.8294	4620	1.8318
1.094	39.9158	4630	1.8249
1.094	40.0	4640	1.8018
1.0865	40.0864	4650	1.8453
1.0865	40.1728	4660	1.8310
1.0865	40.2592	4670	1.8559
1.0865	40.3456	4680	1.8518
1.0865	40.4320	4690	1.8607
1.0865	40.5184	4700	1.8035
1.0865	40.6048	4710	1.8825
1.0865	40.6911	4720	1.8732
1.0865	40.7775	4730	1.8420
1.0865	40.8639	4740	1.7892
1.0865	40.9503	4750	1.8805
1.1005	41.0346	4760	1.8521
1.1005	41.1210	4770	1.8000
1.1005	41.2073	4780	1.8096
1.1005	41.2937	4790	1.8141
1.1005	41.3801	4800	1.8418
1.1005	41.4665	4810	1.8489
1.1005	41.5529	4820	1.8529
1.1005	41.6393	4830	1.8830
1.1005	41.7257	4840	1.8390
1.1005	41.8121	4850	1.8829
1.1005	41.8985	4860	1.7936
1.1005	41.9849	4870	1.8308
1.0966	42.0691	4880	1.7979
1.0966	42.1555	4890	1.8424
1.0966	42.2419	4900	1.7943
1.0966	42.3283	4910	1.9095
1.0966	42.4147	4920	1.8268
1.0966	42.5011	4930	1.8412
1.0966	42.5875	4940	1.8719
1.0966	42.6739	4950	1.8008
1.0966	42.7603	4960	1.7795
1.0966	42.8467	4970	1.9224
1.0966	42.9330	4980	1.8706
1.0823	43.0173	4990	1.7910
1.0823	43.1037	5000	1.7907
1.0823	43.1901	5010	1.8763
1.0823	43.2765	5020	1.8543
1.0823	43.3629	5030	1.8727
1.0823	43.4492	5040	1.8552
1.0823	43.5356	5050	1.8148
1.0823	43.6220	5060	1.8219
1.0823	43.7084	5070	1.7775
1.0823	43.7948	5080	1.8385
1.0823	43.8812	5090	1.8406
1.0823	43.9676	5100	1.8196
1.0845	44.0518	5110	1.7964
1.0845	44.1382	5120	1.8453
1.0845	44.2246	5130	1.8291
1.0845	44.3110	5140	1.7762
1.0845	44.3974	5150	1.8608
1.0845	44.4838	5160	1.8238
1.0845	44.5702	5170	1.8102
1.0845	44.6566	5180	1.8601
1.0845	44.7430	5190	1.8466
1.0845	44.8294	5200	1.8381
1.0845	44.9158	5210	1.8313
1.0845	45.0	5220	1.8479
1.0867	45.0864	5230	1.8427
1.0867	45.1728	5240	1.8168
1.0867	45.2592	5250	1.8953
1.0867	45.3456	5260	1.8511
1.0867	45.4320	5270	1.8428
1.0867	45.5184	5280	1.8752
1.0867	45.6048	5290	1.8412
1.0867	45.6911	5300	1.8688
1.0867	45.7775	5310	1.8370
1.0867	45.8639	5320	1.7898
1.0867	45.9503	5330	1.8051
1.096	46.0346	5340	1.8631
1.096	46.1210	5350	1.8421
1.096	46.2073	5360	1.8906
1.096	46.2937	5370	1.9125
1.096	46.3801	5380	1.8229
1.096	46.4665	5390	1.8269
1.096	46.5529	5400	1.8018
1.096	46.6393	5410	1.8062
1.096	46.7257	5420	1.8331
1.096	46.8121	5430	1.8798
1.096	46.8985	5440	1.7637
1.096	46.9849	5450	1.8185
1.0848	47.0691	5460	1.8077
1.0848	47.1555	5470	1.8615
1.0848	47.2419	5480	1.8289
1.0848	47.3283	5490	1.8088
1.0848	47.4147	5500	1.7663
1.0848	47.5011	5510	1.8334
1.0848	47.5875	5520	1.8417
1.0848	47.6739	5530	1.8120
1.0848	47.7603	5540	1.8671
1.0848	47.8467	5550	1.8458
1.0848	47.9330	5560	1.8585
1.0804	48.0173	5570	1.8166
1.0804	48.1037	5580	1.8545
1.0804	48.1901	5590	1.8249
1.0804	48.2765	5600	1.8190
1.0804	48.3629	5610	1.7856
1.0804	48.4492	5620	1.8436
1.0804	48.5356	5630	1.8446
1.0804	48.6220	5640	1.8597
1.0804	48.7084	5650	1.8216
1.0804	48.7948	5660	1.8378
1.0804	48.8812	5670	1.8856
1.0804	48.9676	5680	1.7959
1.0787	49.0518	5690	1.8838
1.0787	49.1382	5700	1.8024
1.0787	49.2246	5710	1.8125
1.0787	49.3110	5720	1.8247
1.0787	49.3974	5730	1.8088
1.0787	49.4838	5740	1.8650
1.0787	49.5702	5750	1.8146

Framework versions

Transformers 4.48.2
Pytorch 2.4.1+cu121
Datasets 3.0.2
Tokenizers 0.21.0

Task: Fill-Mask
Library: transformers
Type: bert
License: mit
Created: Nov 18, 2025
Updated: Nov 18, 2025