BERiT_wl_custom_architecture_150_epochs

gngpostalsrvc/BERiT_wl_custom_architecture_150_epochs

BERiT_wl_custom_architecture_150_epochs is a fill-mask model from gngpostalsrvc. Use it when you need the model to fill a missing word. It is set up for transformers. The card lists the license as mit.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

4% of all-time downloads

All-time downloads

692

Public

Repo size

6.5 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin43 MB · 96%

At a glance

Task: Fill-Mask
Library: transformers
License: mit
Model type: roberta
Access: Public
Created: Apr 2, 2023
Updated: Apr 2, 2023
SHA: 9b27271c

Try a prompt

Model card

From the Hugging Face model README

BERiT_wl_custom_architecture_150_epochs

This model is a fine-tuned version of roberta-base on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 6.1874

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.0005
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 150

Training results

Training Loss	Epoch	Step	Validation Loss
24.8046	0.19	500	12.7123
11.0129	0.39	1000	9.6736
8.9635	0.58	1500	8.4964
8.0902	0.77	2000	7.8951
7.9548	0.97	2500	7.8226
7.6509	1.16	3000	7.7462
7.6147	1.36	3500	7.6485
7.5591	1.55	4000	7.6231
7.5172	1.74	4500	7.6365
7.4983	1.94	5000	7.4450
7.4245	2.13	5500	7.4577
7.2719	2.32	6000	7.3436
7.3124	2.52	6500	7.3705
7.2521	2.71	7000	7.3035
7.2334	2.9	7500	7.3254
7.2194	3.1	8000	7.2225
7.1485	3.29	8500	7.1902
7.1457	3.49	9000	7.2074
7.0741	3.68	9500	7.1499
7.0648	3.87	10000	7.1375
7.1039	4.07	10500	7.0124
7.063	4.26	11000	7.0609
7.0149	4.45	11500	7.0481
6.9925	4.65	12000	6.9921
7.007	4.84	12500	6.9332
6.9724	5.03	13000	6.9564
6.9151	5.23	13500	6.9191
6.9024	5.42	14000	6.9580
6.9217	5.62	14500	6.9994
6.8691	5.81	15000	6.8627
6.9037	6.0	15500	6.9464
6.9068	6.2	16000	6.8337
6.8132	6.39	16500	6.9507
6.879	6.58	17000	6.8269
6.8611	6.78	17500	6.8231
6.832	6.97	18000	6.8648
6.888	7.16	18500	6.9218
6.846	7.36	19000	6.8436
6.8934	7.55	19500	6.8003
6.8736	7.75	20000	6.7671
6.8185	7.94	20500	6.7706
6.8035	8.13	21000	6.7937
6.8225	8.33	21500	6.7516
6.7246	8.52	22000	6.7865
6.8394	8.71	22500	6.7451
6.8449	8.91	23000	6.7132
6.8184	9.1	23500	6.7226
6.7183	9.3	24000	6.7481
6.7688	9.49	24500	6.8439
6.8213	9.68	25000	6.7382
6.8382	9.88	25500	6.7100
6.8008	10.07	26000	6.7362
6.7856	10.26	26500	6.7150
6.7678	10.46	27000	6.6879
6.7181	10.65	27500	6.6985
6.7794	10.84	28000	6.7540
6.793	11.04	28500	6.6759
6.758	11.23	29000	6.8282
6.7859	11.43	29500	6.7199
6.7246	11.62	30000	6.7159
6.7074	11.81	30500	6.6741
6.7431	12.01	31000	6.5994
6.7848	12.2	31500	6.7413
6.6443	12.39	32000	6.7307
6.713	12.59	32500	6.6367
6.7182	12.78	33000	6.7215
6.6531	12.97	33500	6.6576
6.6817	13.17	34000	6.6298
6.658	13.36	34500	6.6509
6.6476	13.56	35000	6.6960
6.7139	13.75	35500	6.6714
6.7637	13.94	36000	6.6451
6.6502	14.14	36500	6.6299
6.6488	14.33	37000	6.5919
6.6018	14.52	37500	6.6460
6.6399	14.72	38000	6.5534
6.6708	14.91	38500	6.5580
6.618	15.1	39000	6.6200
6.6335	15.3	39500	6.6398
6.6793	15.49	40000	6.6470
6.6304	15.69	40500	6.5910
6.572	15.88	41000	6.6311
6.5509	16.07	41500	6.5615
6.5801	16.27	42000	6.6375
6.5925	16.46	42500	6.5788
6.6053	16.65	43000	6.5777
6.574	16.85	43500	6.5225
6.6412	17.04	44000	6.6745
6.6383	17.23	44500	6.6072
6.5596	17.43	45000	6.6791
6.5853	17.62	45500	6.5915
6.5862	17.82	46000	6.5101
6.5739	18.01	46500	6.5603
6.5988	18.2	47000	6.6307
6.5824	18.4	47500	6.5721
6.6016	18.59	48000	6.6443
6.5254	18.78	48500	6.6235
6.6509	18.98	49000	6.5812
6.5534	19.17	49500	6.6311
6.5439	19.36	50000	6.5190
6.4958	19.56	50500	6.6022
6.5812	19.75	51000	6.6042
6.5624	19.95	51500	6.5598
6.4915	20.14	52000	6.5793
6.495	20.33	52500	6.4773
6.579	20.53	53000	6.4957
6.6115	20.72	53500	6.5144
6.5592	20.91	54000	6.5099
6.5474	21.11	54500	6.4373
6.5568	21.3	55000	6.4581
6.4647	21.49	55500	6.4053
6.5423	21.69	56000	6.4721
6.4784	21.88	56500	6.6378
6.4668	22.08	57000	6.4698
6.53	22.27	57500	6.3605
6.5545	22.46	58000	6.4776
6.5224	22.66	58500	6.5105
6.5243	22.85	59000	6.4652
6.5483	23.04	59500	6.5137
6.4688	23.24	60000	6.3626
6.4506	23.43	60500	6.5526
6.4591	23.63	61000	6.5378
6.5187	23.82	61500	6.4938
6.5293	24.01	62000	6.5242
6.4809	24.21	62500	6.3641
6.4143	24.4	63000	6.5578
6.4946	24.59	63500	6.5679
6.4409	24.79	64000	6.5742
6.5167	24.98	64500	6.4332
6.4738	25.17	65000	6.4865
6.479	25.37	65500	6.4287
6.5774	25.56	66000	6.4854
6.5448	25.76	66500	6.5641
6.4514	25.95	67000	6.5859
6.446	26.14	67500	6.5205
6.5242	26.34	68000	6.3855
6.3822	26.53	68500	6.5322
6.4347	26.72	69000	6.4999
6.4718	26.92	69500	6.5620
6.4764	27.11	70000	6.4305
6.4518	27.3	70500	6.5363
6.4408	27.5	71000	6.5173
6.5088	27.69	71500	6.5415
6.4482	27.89	72000	6.4463
6.4399	28.08	72500	6.6054
6.4729	28.27	73000	6.3815
6.4443	28.47	73500	6.4110
6.3291	28.66	74000	6.5276
6.5036	28.85	74500	6.4105
6.3918	29.05	75000	6.3938
6.4873	29.24	75500	6.5735
6.4014	29.43	76000	6.5164
6.432	29.63	76500	6.4788
6.4125	29.82	77000	6.5010
6.4635	30.02	77500	6.5212
6.4787	30.21	78000	6.4719
6.3789	30.4	78500	6.4668
6.4376	30.6	79000	6.4990
6.4255	30.79	79500	6.5125
6.4482	30.98	80000	6.5029
6.4854	31.18	80500	6.4148
6.3694	31.37	81000	6.3913
6.4794	31.56	81500	6.4093
6.5298	31.76	82000	6.4897
6.4557	31.95	82500	6.5037
6.4667	32.15	83000	6.5143
6.4302	32.34	83500	6.3899
6.3902	32.53	84000	6.3984
6.4345	32.73	84500	6.5251
6.4463	32.92	85000	6.3555
6.4069	33.11	85500	6.5103
6.3956	33.31	86000	6.4315
6.3726	33.5	86500	6.4607
6.4322	33.69	87000	6.4607
6.4396	33.89	87500	6.5517
6.3791	34.08	88000	6.3945
6.4187	34.28	88500	6.4253
6.3014	34.47	89000	6.4347
6.407	34.66	89500	6.3437
6.3979	34.86	90000	6.4753
6.3886	35.05	90500	6.4109
6.4035	35.24	91000	6.4625
6.3834	35.44	91500	6.2892
6.483	35.63	92000	6.3512
6.4095	35.82	92500	6.4270
6.3819	36.02	93000	6.5161
6.3699	36.21	93500	6.3608
6.4221	36.41	94000	6.4575
6.3719	36.6	94500	6.3277
6.3649	36.79	95000	6.4155
6.3472	36.99	95500	6.3126
6.4035	37.18	96000	6.3849
6.4118	37.37	96500	6.3637
6.4002	37.57	97000	6.5024
6.3689	37.76	97500	6.4493
6.4304	37.96	98000	6.3921
6.3789	38.15	98500	6.5012
6.3972	38.34	99000	6.4389
6.3478	38.54	99500	6.3466
6.3232	38.73	100000	6.3382
6.3631	38.92	100500	6.3558
6.3657	39.12	101000	6.3970
6.2932	39.31	101500	6.4777
6.3664	39.5	102000	6.2743
6.3362	39.7	102500	6.3683
6.2768	39.89	103000	6.3196
6.334	40.09	103500	6.3221
6.3592	40.28	104000	6.4366
6.3813	40.47	104500	6.3348
6.3267	40.67	105000	6.4029
6.3469	40.86	105500	6.4179
6.3868	41.05	106000	6.4578
6.3341	41.25	106500	6.2580
6.2609	41.44	107000	6.3612
6.389	41.63	107500	6.3980
6.3666	41.83	108000	6.3497
6.4192	42.02	108500	6.2666
6.3131	42.22	109000	6.5009
6.3601	42.41	109500	6.3073
6.3056	42.6	110000	6.4017
6.2856	42.8	110500	6.4237
6.3414	42.99	111000	6.3046
6.2585	43.18	111500	6.4079
6.3364	43.38	112000	6.3337
6.3018	43.57	112500	6.3583
6.2755	43.76	113000	6.2363
6.3035	43.96	113500	6.4418
6.329	44.15	114000	6.3339
6.3575	44.35	114500	6.2747
6.2961	44.54	115000	6.3100
6.3076	44.73	115500	6.2249
6.2606	44.93	116000	6.4091
6.3815	45.12	116500	6.3758
6.2911	45.31	117000	6.4308
6.3574	45.51	117500	6.3929
6.3193	45.7	118000	6.3429
6.2575	45.89	118500	6.4090
6.3526	46.09	119000	6.3755
6.3276	46.28	119500	6.2963
6.312	46.48	120000	6.3950
6.3039	46.67	120500	6.3574
6.3238	46.86	121000	6.4058
6.3289	47.06	121500	6.3378
6.2875	47.25	122000	6.3826
6.2757	47.44	122500	6.3762
6.3295	47.64	123000	6.3390
6.3808	47.83	123500	6.4283
6.2946	48.02	124000	6.4961
6.2336	48.22	124500	6.4333
6.2962	48.41	125000	6.3670
6.2817	48.61	125500	6.4529
6.3436	48.8	126000	6.4104
6.3781	48.99	126500	6.4424
6.2011	49.19	127000	6.3477
6.2685	49.38	127500	6.5722
6.3064	49.57	128000	6.2416
6.281	49.77	128500	6.2986
6.2667	49.96	129000	6.5320
6.2257	50.15	129500	6.3083
6.3593	50.35	130000	6.2661
6.2716	50.54	130500	6.4043
6.3103	50.74	131000	6.2645
6.3174	50.93	131500	6.3595
6.2355	51.12	132000	6.5065
6.2585	51.32	132500	6.3787
6.2728	51.51	133000	6.4104
6.2537	51.7	133500	6.3260
6.2933	51.9	134000	6.3715
6.1818	52.09	134500	6.2909
6.2838	52.29	135000	6.3538
6.233	52.48	135500	6.3544
6.2805	52.67	136000	6.3863
6.2157	52.87	136500	6.3701
6.2898	53.06	137000	6.3410
6.345	53.25	137500	6.3239
6.2705	53.45	138000	6.4318
6.2903	53.64	138500	6.2804
6.263	53.83	139000	6.3537
6.2182	54.03	139500	6.3480
6.2744	54.22	140000	6.3195
6.3152	54.42	140500	6.3934
6.2659	54.61	141000	6.3332
6.2617	54.8	141500	6.2579
6.3094	55.0	142000	6.2328
6.3308	55.19	142500	6.4148
6.2936	55.38	143000	6.2176
6.2945	55.58	143500	6.4020
6.1785	55.77	144000	6.1351
6.2737	55.96	144500	6.2304
6.2682	56.16	145000	6.2812
6.2155	56.35	145500	6.2700
6.226	56.55	146000	6.2475
6.2009	56.74	146500	6.3340
6.2521	56.93	147000	6.3261
6.1959	57.13	147500	6.3872
6.2285	57.32	148000	6.3304
6.2091	57.51	148500	6.3322
6.239	57.71	149000	6.2846
6.1941	57.9	149500	6.4017
6.2541	58.09	150000	6.2042
6.226	58.29	150500	6.3695
6.2403	58.48	151000	6.3264
6.2554	58.68	151500	6.2559
6.3007	58.87	152000	6.3502
6.2424	59.06	152500	6.3547
6.2272	59.26	153000	6.4295
6.1892	59.45	153500	6.6607
6.2815	59.64	154000	6.3525
6.2244	59.84	154500	6.3523
6.2797	60.03	155000	6.3626
6.2187	60.22	155500	6.4222
6.2169	60.42	156000	6.3485
6.2496	60.61	156500	6.3356
6.1102	60.81	157000	6.3071
6.3578	61.0	157500	6.3002
6.2318	61.19	158000	6.4061
6.2639	61.39	158500	6.3478
6.2794	61.58	159000	6.2974
6.2083	61.77	159500	6.3217
6.2093	61.97	160000	6.3045
6.1462	62.16	160500	6.1949
6.3406	62.35	161000	6.4346
6.2244	62.55	161500	6.3671
6.1255	62.74	162000	6.2972
6.1893	62.94	162500	6.4379
6.3224	63.13	163000	6.3682
6.1818	63.32	163500	6.4431
6.2361	63.52	164000	6.3767
6.244	63.71	164500	6.2516
6.187	63.9	165000	6.3070
6.1588	64.1	165500	6.4251
6.1975	64.29	166000	6.2673
6.2274	64.48	166500	6.3508
6.2535	64.68	167000	6.4831
6.2225	64.87	167500	6.3635
6.2468	65.07	168000	6.2326
6.2217	65.26	168500	6.4788
6.2087	65.45	169000	6.3234
6.2096	65.65	169500	6.2796
6.2535	65.84	170000	6.4544
6.2393	66.03	170500	6.4444
6.1029	66.23	171000	6.3661
6.2625	66.42	171500	6.3198
6.2007	66.62	172000	6.2895
6.2242	66.81	172500	6.3142
6.1879	67.0	173000	6.2988
6.2059	67.2	173500	6.3206
6.1516	67.39	174000	6.3751
6.1668	67.58	174500	6.4656
6.2432	67.78	175000	6.3792
6.2393	67.97	175500	6.2346
6.1305	68.16	176000	6.3603
6.178	68.36	176500	6.2234
6.212	68.55	177000	6.4403
6.2127	68.75	177500	6.5191
6.2136	68.94	178000	6.2183
6.2512	69.13	178500	6.3650
6.1163	69.33	179000	6.5378
6.1848	69.52	179500	6.4186
6.1964	69.71	180000	6.2395
6.1588	69.91	180500	6.5267
6.1854	70.1	181000	6.3233
6.1393	70.29	181500	6.3408
6.2122	70.49	182000	6.3399
6.222	70.68	182500	6.4418
6.1902	70.88	183000	6.4005
6.2175	71.07	183500	6.2667
6.2296	71.26	184000	6.3934
6.1185	71.46	184500	6.3090
6.1187	71.65	185000	6.3091
6.2343	71.84	185500	6.3387
6.2313	72.04	186000	6.4123
6.1379	72.23	186500	6.4942
6.238	72.42	187000	6.3057
6.1262	72.62	187500	6.4627
6.1365	72.81	188000	6.2741
6.1417	73.01	188500	6.3133
6.149	73.2	189000	6.3316
6.204	73.39	189500	6.3873
6.2358	73.59	190000	6.2632
6.16	73.78	190500	6.3650
6.2077	73.97	191000	6.4518
6.1722	74.17	191500	6.2005
6.0955	74.36	192000	6.2851
6.1319	74.55	192500	6.2528
6.1369	74.75	193000	6.5142
6.2238	74.94	193500	6.3739
6.1216	75.14	194000	6.2585
6.1693	75.33	194500	6.3033
6.12	75.52	195000	6.3827
6.2106	75.72	195500	6.2327
6.2167	75.91	196000	6.2846
6.1482	76.1	196500	6.4921
6.1469	76.3	197000	6.3111
6.1408	76.49	197500	6.3837
6.1839	76.68	198000	6.2321
6.2089	76.88	198500	6.3958
6.105	77.07	199000	6.4688
6.1359	77.27	199500	6.3164
6.0968	77.46	200000	6.3570
6.1781	77.65	200500	6.2488
6.1875	77.85	201000	6.2816
6.1976	78.04	201500	6.4296
6.1707	78.23	202000	6.1862
6.151	78.43	202500	6.3307
6.1146	78.62	203000	6.3054
6.1971	78.81	203500	6.3942
6.2385	79.01	204000	6.2846
6.1088	79.2	204500	6.5546
6.1813	79.4	205000	6.4800
6.2204	79.59	205500	6.3196
6.1673	79.78	206000	6.4677
6.2331	79.98	206500	6.2786
6.0863	80.17	207000	6.3500
6.1129	80.36	207500	6.2943
6.158	80.56	208000	6.3409
6.1544	80.75	208500	6.2672
6.1335	80.95	209000	6.3621
6.224	81.14	209500	6.3680
6.0753	81.33	210000	6.1947
6.1137	81.53	210500	6.4236
6.1313	81.72	211000	6.2549
6.2197	81.91	211500	6.2092
6.1815	82.11	212000	6.3099
6.0535	82.3	212500	6.4345
6.1012	82.49	213000	6.2444
6.1536	82.69	213500	6.4629
6.1593	82.88	214000	6.2807
6.1092	83.08	214500	6.3169
6.1626	83.27	215000	6.1781
6.1653	83.46	215500	6.3139
6.2015	83.66	216000	6.4126
6.1827	83.85	216500	6.3927
6.1526	84.04	217000	6.2633
6.1705	84.24	217500	6.4309
6.0917	84.43	218000	6.4007
6.1351	84.62	218500	6.2670
6.0758	84.82	219000	6.4789
6.0173	85.01	219500	6.3091
6.1034	85.21	220000	6.3755
6.1238	85.4	220500	6.6736
6.1324	85.59	221000	6.3754
6.1871	85.79	221500	6.2746
6.1551	85.98	222000	6.4359
6.2199	86.17	222500	6.2856
6.1714	86.37	223000	6.1998
6.0669	86.56	223500	6.4683
6.1031	86.75	224000	6.1940
6.1374	86.95	224500	6.4674
6.1401	87.14	225000	6.3528
6.1558	87.34	225500	6.4459
6.0512	87.53	226000	6.1757
6.1377	87.72	226500	6.2645
6.1375	87.92	227000	6.2402
6.0926	88.11	227500	6.3162
6.0877	88.3	228000	6.3065
6.0844	88.5	228500	6.4125
6.0767	88.69	229000	6.4825
6.191	88.88	229500	6.3003
6.1155	89.08	230000	6.4964
6.1384	89.27	230500	6.2906
6.0938	89.47	231000	6.2359
6.1078	89.66	231500	6.2931
6.131	89.85	232000	6.4932
6.0469	90.05	232500	6.3953
6.0826	90.24	233000	6.2308
6.1054	90.43	233500	6.4096
6.128	90.63	234000	6.3669
6.0942	90.82	234500	6.2291
6.0902	91.01	235000	6.4129
6.0365	91.21	235500	6.4048
6.103	91.4	236000	6.3340
6.1112	91.6	236500	6.5937
6.1402	91.79	237000	6.3795
6.1814	91.98	237500	6.4101
6.0968	92.18	238000	6.3921
6.0877	92.37	238500	6.2881
6.1681	92.56	239000	6.3770
6.0637	92.76	239500	6.3274
6.0718	92.95	240000	6.3356
6.1199	93.14	240500	6.2784
6.0929	93.34	241000	6.4138
6.1539	93.53	241500	6.2909
6.1256	93.73	242000	6.2933
6.1872	93.92	242500	6.2459
6.1	94.11	243000	6.3982
6.1501	94.31	243500	6.2645
6.0529	94.5	244000	6.3445
6.0918	94.69	244500	6.2230
6.1225	94.89	245000	6.3748
5.9916	95.08	245500	6.2621
6.1878	95.27	246000	6.3305
6.0875	95.47	246500	6.2892
6.0954	95.66	247000	6.2581
6.1167	95.86	247500	6.2420
6.1107	96.05	248000	6.4639
6.0755	96.24	248500	6.3044
6.0976	96.44	249000	6.3260
6.1027	96.63	249500	6.2483
6.1056	96.82	250000	6.3190
6.0187	97.02	250500	6.2452
6.1126	97.21	251000	6.2942
6.1266	97.41	251500	6.4213
6.1217	97.6	252000	6.3464
6.0499	97.79	252500	6.3229
6.1124	97.99	253000	6.3027
6.108	98.18	253500	6.4417
6.0534	98.37	254000	6.3782
6.0398	98.57	254500	6.3178
6.047	98.76	255000	6.3298
6.1422	98.95	255500	6.3007
6.1034	99.15	256000	6.3839
6.0293	99.34	256500	6.4343
6.0068	99.54	257000	6.3719
6.1498	99.73	257500	6.2130
6.1296	99.92	258000	6.2153
6.0647	100.12	258500	6.3747
6.1241	100.31	259000	6.2765
6.0512	100.5	259500	6.1901
6.0628	100.7	260000	6.2999
6.1612	100.89	260500	6.4049
6.1089	101.08	261000	6.3761
6.0248	101.28	261500	6.3189
6.0749	101.47	262000	6.3750
6.0599	101.67	262500	6.3957
6.0651	101.86	263000	6.3435
6.1145	102.05	263500	6.3425
6.0432	102.25	264000	6.2033
6.0281	102.44	264500	6.0788
6.0403	102.63	265000	6.3782
6.0782	102.83	265500	6.2826
6.1114	103.02	266000	6.2191
6.0744	103.21	266500	6.2138
6.1456	103.41	267000	6.3423
6.0652	103.6	267500	6.3511
6.1563	103.8	268000	6.0975
6.167	103.99	268500	6.3246
6.0227	104.18	269000	6.4232
6.0676	104.38	269500	6.6261
6.0941	104.57	270000	6.2981
6.0018	104.76	270500	6.3241
6.052	104.96	271000	6.3419
6.0276	105.15	271500	6.2942
5.9867	105.34	272000	6.3718
6.0223	105.54	272500	6.3350
6.0527	105.73	273000	6.1741
6.0598	105.93	273500	6.2026
6.0823	106.12	274000	6.3846
6.0429	106.31	274500	6.1483
6.0723	106.51	275000	6.1797
6.0744	106.7	275500	6.4179
6.0975	106.89	276000	6.2767
6.0867	107.09	276500	6.3929
6.0149	107.28	277000	6.2163
6.0958	107.47	277500	6.3619
6.0795	107.67	278000	6.2430
5.9994	107.86	278500	6.2854
6.0246	108.06	279000	6.2356
5.9845	108.25	279500	6.4934
6.0587	108.44	280000	6.1357
6.0536	108.64	280500	6.2619
6.1245	108.83	281000	6.2436
6.04	109.02	281500	6.2919
6.0972	109.22	282000	6.2054
6.0376	109.41	282500	6.3734
6.0864	109.6	283000	6.3019
5.9986	109.8	283500	6.1834
6.0949	109.99	284000	6.3342
6.0034	110.19	284500	6.2156
6.016	110.38	285000	6.3797
6.0444	110.57	285500	6.2416
6.0143	110.77	286000	6.3332
5.9775	110.96	286500	6.2513
6.0207	111.15	287000	6.3844
5.9872	111.35	287500	6.3577
6.1172	111.54	288000	6.2747
6.0457	111.74	288500	6.1936
6.0373	111.93	289000	6.1718
6.0713	112.12	289500	6.3335
6.1118	112.32	290000	6.2619
6.0094	112.51	290500	6.2070
6.0613	112.7	291000	6.2200
6.1184	112.9	291500	6.4332
5.9915	113.09	292000	6.2745
6.0551	113.28	292500	6.2810
6.0033	113.48	293000	6.2718
5.9226	113.67	293500	6.3007
6.0805	113.87	294000	6.1925
6.0287	114.06	294500	6.4383
6.0515	114.25	295000	6.3062
5.9819	114.45	295500	6.2525
6.0159	114.64	296000	6.2048
5.976	114.83	296500	6.3714
6.1055	115.03	297000	6.1493
6.0823	115.22	297500	6.2946
5.9474	115.41	298000	6.2729
6.0996	115.61	298500	6.2949
6.0486	115.8	299000	6.2528
6.0683	116.0	299500	6.1331
6.0145	116.19	300000	6.3231
5.9884	116.38	300500	6.2335
6.0666	116.58	301000	6.1505
6.068	116.77	301500	6.3078
5.989	116.96	302000	6.3503
5.9933	117.16	302500	6.2192
5.9957	117.35	303000	6.4492
6.0553	117.54	303500	6.2934
6.0764	117.74	304000	6.2388
6.1034	117.93	304500	6.3082
6.0721	118.13	305000	6.1408
5.9929	118.32	305500	6.3172
5.9634	118.51	306000	6.1190
6.0719	118.71	306500	6.1553
6.1254	118.9	307000	6.3389
5.986	119.09	307500	6.1912
6.0306	119.29	308000	6.3616
6.0372	119.48	308500	6.2718
6.0292	119.67	309000	6.4873
6.0608	119.87	309500	6.3311
6.0595	120.06	310000	6.3818
5.9674	120.26	310500	6.3674
6.0378	120.45	311000	6.3055
6.0668	120.64	311500	6.1886
6.0235	120.84	312000	6.3711
5.9634	121.03	312500	6.2133
5.9416	121.22	313000	6.2171
5.9672	121.42	313500	6.3439
5.9954	121.61	314000	6.2243
6.0735	121.8	314500	6.1662
6.0652	122.0	315000	6.2343
6.0415	122.19	315500	6.2711
5.941	122.39	316000	6.2159
6.0866	122.58	316500	6.1542
6.1004	122.77	317000	6.3206
6.0116	122.97	317500	6.3592
6.052	123.16	318000	6.1616
6.0093	123.35	318500	6.2311
5.9723	123.55	319000	6.2176
5.9651	123.74	319500	6.2870
5.9994	123.93	320000	6.1601
6.0534	124.13	320500	6.1234
5.9759	124.32	321000	6.1133
6.0716	124.52	321500	6.1318
5.9999	124.71	322000	6.2723
5.9449	124.9	322500	6.3393
5.9497	125.1	323000	6.3490
6.0081	125.29	323500	6.2434
5.9899	125.48	324000	6.2355
5.9943	125.68	324500	6.2021
6.039	125.87	325000	6.2081
5.971	126.07	325500	6.2518
6.0113	126.26	326000	6.2984
5.9926	126.45	326500	6.1162
5.9795	126.65	327000	6.1953
5.9839	126.84	327500	6.3870
6.0708	127.03	328000	6.2780
5.9934	127.23	328500	6.2218
5.9169	127.42	329000	6.2205
6.0101	127.61	329500	6.2630
5.9775	127.81	330000	6.0953
6.0563	128.0	330500	6.2625
5.9326	128.2	331000	6.3160
6.0056	128.39	331500	6.2531
5.9701	128.58	332000	6.3291
5.9928	128.78	332500	6.2678
6.0317	128.97	333000	6.2241
5.9644	129.16	333500	6.3432
5.9619	129.36	334000	6.2009
6.0502	129.55	334500	6.2666
6.0493	129.74	335000	6.3265
5.9662	129.94	335500	6.2069
5.929	130.13	336000	6.3107
5.8884	130.33	336500	6.2392
6.0248	130.52	337000	6.3263
5.9749	130.71	337500	6.2351
6.0686	130.91	338000	6.1432
5.979	131.1	338500	6.2057
5.9756	131.29	339000	6.1497
6.0542	131.49	339500	6.2669
6.0454	131.68	340000	6.2311
6.0368	131.87	340500	6.0745
6.0784	132.07	341000	6.1181
5.8907	132.26	341500	6.2473
5.9635	132.46	342000	6.1953
5.9559	132.65	342500	6.0708
5.9116	132.84	343000	6.1112
6.0154	133.04	343500	6.2833
6.0474	133.23	344000	6.2091
5.9661	133.42	344500	6.1129
5.9438	133.62	345000	6.2510
5.9498	133.81	345500	6.1699
5.9987	134.0	346000	6.0196
6.0424	134.2	346500	6.2066
5.9929	134.39	347000	6.2394
5.9699	134.59	347500	6.1630
5.972	134.78	348000	6.3057
5.8912	134.97	348500	6.2970
5.9103	135.17	349000	6.3566
6.0203	135.36	349500	6.2139
5.9869	135.55	350000	6.0769
5.9502	135.75	350500	6.0977
6.0137	135.94	351000	6.1849
5.9812	136.13	351500	6.1549
5.9503	136.33	352000	6.2457
5.9875	136.52	352500	6.2826
5.9876	136.72	353000	6.3110
6.042	136.91	353500	6.1327
6.0329	137.1	354000	6.1691
5.9558	137.3	354500	6.2415
5.9064	137.49	355000	6.3041
6.083	137.68	355500	6.2303
6.0357	137.88	356000	6.1209
6.0468	138.07	356500	6.1150
5.964	138.26	357000	6.1214
5.9884	138.46	357500	6.1821
5.9335	138.65	358000	6.1667
5.9968	138.85	358500	6.2252
5.9721	139.04	359000	6.2437
5.913	139.23	359500	6.2301
5.9755	139.43	360000	6.1756
5.9696	139.62	360500	6.1874
6.0092	139.81	361000	6.0900
5.9676	140.01	361500	6.1980
5.9832	140.2	362000	6.1899
5.9993	140.4	362500	6.1638
5.9506	140.59	363000	6.1104
6.0256	140.78	363500	6.1285
6.0368	140.98	364000	6.1401
5.9722	141.17	364500	6.2675
5.9025	141.36	365000	6.2461
6.0218	141.56	365500	6.1901
6.0086	141.75	366000	6.0529
5.9125	141.94	366500	6.1999
5.9919	142.14	367000	6.0962
6.0066	142.33	367500	6.2817
5.9304	142.53	368000	6.1493
5.9526	142.72	368500	6.2055
6.039	142.91	369000	6.1313
6.0084	143.11	369500	6.2798
5.9637	143.3	370000	6.0965
5.9513	143.49	370500	6.2137
5.9422	143.69	371000	6.1663
5.9425	143.88	371500	6.0414
5.9642	144.07	372000	6.2704
6.0213	144.27	372500	6.3381
6.014	144.46	373000	6.2437
5.9038	144.66	373500	6.1289
5.96	144.85	374000	6.2737
6.0191	145.04	374500	6.1252
5.9451	145.24	375000	6.2172
5.9917	145.43	375500	6.0619
6.019	145.62	376000	6.1719
5.9217	145.82	376500	6.1744
5.9741	146.01	377000	6.3044
5.951	146.2	377500	6.3080
5.9659	146.4	378000	6.1352
5.9307	146.59	378500	6.2410
5.9273	146.79	379000	6.2210
5.9551	146.98	379500	6.1247
6.0192	147.17	380000	6.2649
5.9587	147.37	380500	6.2528
5.9878	147.56	381000	6.0906
5.937	147.75	381500	6.3361
6.0034	147.95	382000	6.1559
5.9791	148.14	382500	6.2430
5.8866	148.33	383000	6.1914
5.9565	148.53	383500	6.1851
5.9583	148.72	384000	6.1961
5.9533	148.92	384500	6.2176
6.0106	149.11	385000	6.2071
5.9114	149.3	385500	6.1565
5.9484	149.5	386000	6.1509
5.9565	149.69	386500	6.1340
6.0005	149.88	387000	6.1874

Framework versions

Transformers 4.27.4
Pytorch 1.13.1+cu116
Datasets 2.11.0
Tokenizers 0.13.2

Task: Fill-Mask
Library: transformers
Type: roberta
License: mit
Created: Apr 2, 2023
Updated: Apr 2, 2023