ASAP_FineTuningBERT_AugV4_k5_task1_organization_fold1

MayBashendy/ASAP_FineTuningBERT_AugV4_k5_task1_organization_fold1

ASAP_FineTuningBERT_AugV4_k5_task1_organization_fold1 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

21% of all-time downloads

All-time downloads

Public

Parameters

109M

1.8 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors438 MB · 100%

At a glance

Task: Text Classification
Library: transformers
License: apache-2.0
Model type: bert
Access: Public
Created: Nov 18, 2024
Updated: Nov 24, 2024
SHA: 8cd81a0e

Try a prompt

Base models

Model card

From the Hugging Face model README

ASAP_FineTuningBERT_AugV4_k5_task1_organization_fold1

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.5973
Qwk: 0.5540
Mse: 0.5973
Rmse: 0.7728

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 32
eval_batch_size: 32
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0038	2	8.5454	0.0018	8.5454	2.9232
No log	0.0076	4	7.4939	0.0	7.4939	2.7375
No log	0.0114	6	5.9116	0.0252	5.9116	2.4314
No log	0.0152	8	4.8136	0.0142	4.8136	2.1940
No log	0.0189	10	3.8257	0.0040	3.8257	1.9559
No log	0.0227	12	3.1654	0.0	3.1654	1.7792
No log	0.0265	14	2.4616	0.0279	2.4616	1.5689
No log	0.0303	16	2.1533	0.0165	2.1533	1.4674
No log	0.0341	18	1.4879	0.0211	1.4879	1.2198
No log	0.0379	20	1.1861	0.0	1.1861	1.0891
No log	0.0417	22	0.9594	-0.0025	0.9594	0.9795
No log	0.0455	24	0.8508	0.2027	0.8508	0.9224
No log	0.0492	26	0.8985	0.0607	0.8985	0.9479
No log	0.0530	28	0.9406	0.0429	0.9406	0.9699
No log	0.0568	30	0.9713	0.0429	0.9713	0.9855
No log	0.0606	32	0.9567	0.0126	0.9567	0.9781
No log	0.0644	34	1.1855	0.0	1.1855	1.0888
No log	0.0682	36	1.2270	0.0	1.2270	1.1077
No log	0.0720	38	0.8680	0.0713	0.8680	0.9317
No log	0.0758	40	0.8477	0.0890	0.8477	0.9207
No log	0.0795	42	1.1093	0.0	1.1093	1.0533
No log	0.0833	44	1.1177	0.0143	1.1177	1.0572
No log	0.0871	46	1.0934	0.0143	1.0934	1.0457
No log	0.0909	48	0.9901	0.0179	0.9901	0.9950
No log	0.0947	50	1.1068	0.0	1.1068	1.0520
No log	0.0985	52	1.2486	0.0	1.2486	1.1174
No log	0.1023	54	1.1750	0.0	1.1750	1.0840
No log	0.1061	56	0.9833	0.0	0.9833	0.9916
No log	0.1098	58	1.0334	0.0	1.0334	1.0166
No log	0.1136	60	1.1903	0.0	1.1903	1.0910
No log	0.1174	62	1.1399	0.0	1.1399	1.0677
No log	0.1212	64	0.9003	0.0143	0.9003	0.9488
No log	0.125	66	0.8410	0.0713	0.8410	0.9171
No log	0.1288	68	0.8359	0.0713	0.8359	0.9143
No log	0.1326	70	0.8996	0.0571	0.8996	0.9485
No log	0.1364	72	1.0536	0.0143	1.0536	1.0265
No log	0.1402	74	1.0625	0.0143	1.0625	1.0308
No log	0.1439	76	1.0593	0.0143	1.0593	1.0292
No log	0.1477	78	0.9195	0.0660	0.9195	0.9589
No log	0.1515	80	0.8977	0.0660	0.8977	0.9475
No log	0.1553	82	0.8575	0.0926	0.8575	0.9260
No log	0.1591	84	0.8983	0.0749	0.8983	0.9478
No log	0.1629	86	0.8441	0.1877	0.8441	0.9187
No log	0.1667	88	0.7791	0.2375	0.7791	0.8826
No log	0.1705	90	0.8385	0.3121	0.8385	0.9157
No log	0.1742	92	0.9201	0.3879	0.9201	0.9592
No log	0.1780	94	0.7252	0.3469	0.7252	0.8516
No log	0.1818	96	0.6666	0.3740	0.6666	0.8164
No log	0.1856	98	0.7643	0.2469	0.7643	0.8743
No log	0.1894	100	1.1919	0.3027	1.1919	1.0918
No log	0.1932	102	1.2869	0.2277	1.2869	1.1344
No log	0.1970	104	0.9357	0.3337	0.9357	0.9673
No log	0.2008	106	0.7109	0.3646	0.7109	0.8431
No log	0.2045	108	0.7068	0.2894	0.7068	0.8407
No log	0.2083	110	0.8364	0.2795	0.8364	0.9145
No log	0.2121	112	0.8386	0.2468	0.8386	0.9158
No log	0.2159	114	0.7033	0.2304	0.7033	0.8386
No log	0.2197	116	0.6760	0.3000	0.6760	0.8222
No log	0.2235	118	0.6636	0.3975	0.6636	0.8146
No log	0.2273	120	0.8682	0.3799	0.8682	0.9318
No log	0.2311	122	0.9262	0.3672	0.9262	0.9624
No log	0.2348	124	0.8587	0.4195	0.8587	0.9267
No log	0.2386	126	1.0139	0.3616	1.0139	1.0069
No log	0.2424	128	1.0849	0.3565	1.0849	1.0416
No log	0.2462	130	1.1606	0.3432	1.1606	1.0773
No log	0.25	132	0.8001	0.4080	0.8001	0.8945
No log	0.2538	134	0.5823	0.4651	0.5823	0.7631
No log	0.2576	136	0.5536	0.4653	0.5536	0.7440
No log	0.2614	138	0.5667	0.4078	0.5667	0.7528
No log	0.2652	140	0.7142	0.3569	0.7142	0.8451
No log	0.2689	142	0.6863	0.2798	0.6863	0.8284
No log	0.2727	144	0.6103	0.3499	0.6103	0.7812
No log	0.2765	146	0.6141	0.3872	0.6141	0.7837
No log	0.2803	148	0.7583	0.4337	0.7583	0.8708
No log	0.2841	150	0.6532	0.4623	0.6532	0.8082
No log	0.2879	152	0.5685	0.4774	0.5685	0.7540
No log	0.2917	154	0.5844	0.4891	0.5844	0.7645
No log	0.2955	156	0.7681	0.4375	0.7681	0.8764
No log	0.2992	158	0.8588	0.3952	0.8588	0.9267
No log	0.3030	160	0.6743	0.4669	0.6743	0.8211
No log	0.3068	162	0.6728	0.4665	0.6728	0.8203
No log	0.3106	164	0.6676	0.4736	0.6676	0.8171
No log	0.3144	166	0.5498	0.5104	0.5498	0.7415
No log	0.3182	168	0.5162	0.5373	0.5162	0.7185
No log	0.3220	170	0.5014	0.5628	0.5014	0.7081
No log	0.3258	172	0.6414	0.5217	0.6414	0.8009
No log	0.3295	174	0.6487	0.5165	0.6487	0.8054
No log	0.3333	176	0.5029	0.5469	0.5029	0.7091
No log	0.3371	178	0.5579	0.4819	0.5579	0.7470
No log	0.3409	180	0.5310	0.4939	0.5310	0.7287
No log	0.3447	182	0.5221	0.5231	0.5221	0.7226
No log	0.3485	184	0.5166	0.5933	0.5166	0.7187
No log	0.3523	186	0.5067	0.6210	0.5067	0.7118
No log	0.3561	188	0.5119	0.6390	0.5119	0.7155
No log	0.3598	190	0.5764	0.5962	0.5764	0.7592
No log	0.3636	192	0.5052	0.6590	0.5052	0.7108
No log	0.3674	194	0.5105	0.6051	0.5105	0.7145
No log	0.3712	196	0.5365	0.6033	0.5365	0.7324
No log	0.375	198	0.6780	0.5257	0.6780	0.8234
No log	0.3788	200	0.5695	0.5558	0.5695	0.7547
No log	0.3826	202	0.4979	0.5977	0.4979	0.7056
No log	0.3864	204	0.5025	0.5753	0.5025	0.7088
No log	0.3902	206	0.5513	0.5673	0.5513	0.7425
No log	0.3939	208	0.5783	0.5398	0.5783	0.7605
No log	0.3977	210	0.5490	0.5318	0.5490	0.7409
No log	0.4015	212	0.5158	0.5175	0.5158	0.7182
No log	0.4053	214	0.5188	0.5156	0.5188	0.7202
No log	0.4091	216	0.4976	0.5639	0.4976	0.7054
No log	0.4129	218	0.5284	0.5555	0.5284	0.7269
No log	0.4167	220	0.5075	0.5340	0.5075	0.7124
No log	0.4205	222	0.5116	0.5324	0.5116	0.7153
No log	0.4242	224	0.5573	0.5523	0.5573	0.7465
No log	0.4280	226	0.5791	0.5462	0.5791	0.7610
No log	0.4318	228	0.5255	0.5388	0.5255	0.7249
No log	0.4356	230	0.8084	0.3983	0.8084	0.8991
No log	0.4394	232	0.6939	0.4062	0.6939	0.8330
No log	0.4432	234	0.5490	0.4762	0.5490	0.7409
No log	0.4470	236	0.7544	0.4496	0.7544	0.8686
No log	0.4508	238	0.8044	0.4381	0.8044	0.8969
No log	0.4545	240	0.5885	0.4865	0.5885	0.7672
No log	0.4583	242	0.5432	0.5276	0.5432	0.7370
No log	0.4621	244	0.5366	0.5064	0.5366	0.7325
No log	0.4659	246	0.5231	0.5306	0.5231	0.7232
No log	0.4697	248	0.5356	0.5504	0.5356	0.7319
No log	0.4735	250	0.5716	0.5458	0.5716	0.7560
No log	0.4773	252	0.5252	0.5606	0.5252	0.7247
No log	0.4811	254	0.5321	0.5509	0.5321	0.7295
No log	0.4848	256	0.5371	0.5441	0.5371	0.7329
No log	0.4886	258	0.5369	0.5377	0.5369	0.7327
No log	0.4924	260	0.5474	0.5287	0.5474	0.7399
No log	0.4962	262	0.5693	0.4801	0.5693	0.7545
No log	0.5	264	0.5672	0.4769	0.5672	0.7531
No log	0.5038	266	0.5394	0.5304	0.5394	0.7344
No log	0.5076	268	0.6385	0.5109	0.6385	0.7991
No log	0.5114	270	0.6711	0.5115	0.6711	0.8192
No log	0.5152	272	0.5520	0.5467	0.5520	0.7430
No log	0.5189	274	0.5353	0.5666	0.5353	0.7317
No log	0.5227	276	0.5346	0.5745	0.5346	0.7312
No log	0.5265	278	0.5670	0.5644	0.5670	0.7530
No log	0.5303	280	0.5349	0.5639	0.5349	0.7314
No log	0.5341	282	0.5660	0.5514	0.5660	0.7523
No log	0.5379	284	0.5985	0.5042	0.5985	0.7736
No log	0.5417	286	0.5045	0.5650	0.5045	0.7103
No log	0.5455	288	0.5710	0.5541	0.5710	0.7557
No log	0.5492	290	0.5516	0.5763	0.5516	0.7427
No log	0.5530	292	0.4976	0.5932	0.4976	0.7054
No log	0.5568	294	0.5151	0.5628	0.5151	0.7177
No log	0.5606	296	0.4928	0.6072	0.4928	0.7020
No log	0.5644	298	0.4923	0.6088	0.4923	0.7016
No log	0.5682	300	0.5113	0.6059	0.5113	0.7151
No log	0.5720	302	0.5382	0.5944	0.5382	0.7336
No log	0.5758	304	0.4973	0.6221	0.4973	0.7052
No log	0.5795	306	0.4859	0.6286	0.4859	0.6971
No log	0.5833	308	0.5097	0.6391	0.5097	0.7139
No log	0.5871	310	0.4975	0.6457	0.4975	0.7053
No log	0.5909	312	0.4960	0.6497	0.4960	0.7043
No log	0.5947	314	0.4887	0.6529	0.4887	0.6991
No log	0.5985	316	0.5299	0.6032	0.5299	0.7279
No log	0.6023	318	0.4979	0.6149	0.4979	0.7056
No log	0.6061	320	0.5497	0.5849	0.5497	0.7414
No log	0.6098	322	0.5316	0.5883	0.5316	0.7291
No log	0.6136	324	0.4789	0.5872	0.4789	0.6920
No log	0.6174	326	0.4763	0.5858	0.4763	0.6902
No log	0.6212	328	0.5166	0.6004	0.5166	0.7188
No log	0.625	330	0.4839	0.6133	0.4839	0.6956
No log	0.6288	332	0.5811	0.5316	0.5811	0.7623
No log	0.6326	334	0.6199	0.5183	0.6199	0.7873
No log	0.6364	336	0.4822	0.6475	0.4822	0.6944
No log	0.6402	338	0.5462	0.6325	0.5462	0.7390
No log	0.6439	340	0.5883	0.5900	0.5883	0.7670
No log	0.6477	342	0.5220	0.6024	0.5220	0.7225
No log	0.6515	344	0.4892	0.6026	0.4892	0.6994
No log	0.6553	346	0.4987	0.5660	0.4987	0.7062
No log	0.6591	348	0.5670	0.5332	0.5670	0.7530
No log	0.6629	350	0.6258	0.5218	0.6258	0.7911
No log	0.6667	352	0.5120	0.5585	0.5120	0.7155
No log	0.6705	354	0.5058	0.5884	0.5058	0.7112
No log	0.6742	356	0.5210	0.6000	0.5210	0.7218
No log	0.6780	358	0.5064	0.5885	0.5064	0.7116
No log	0.6818	360	0.6881	0.5282	0.6881	0.8295
No log	0.6856	362	0.7458	0.5217	0.7458	0.8636
No log	0.6894	364	0.5242	0.6372	0.5242	0.7240
No log	0.6932	366	0.6181	0.5326	0.6181	0.7862
No log	0.6970	368	0.6448	0.5249	0.6448	0.8030
No log	0.7008	370	0.4912	0.6480	0.4912	0.7008
No log	0.7045	372	0.6392	0.5446	0.6392	0.7995
No log	0.7083	374	0.6023	0.5625	0.6023	0.7761
No log	0.7121	376	0.5007	0.5991	0.5007	0.7076
No log	0.7159	378	0.6134	0.5040	0.6134	0.7832
No log	0.7197	380	0.5565	0.5332	0.5565	0.7460
No log	0.7235	382	0.5459	0.5431	0.5459	0.7389
No log	0.7273	384	0.6501	0.5099	0.6501	0.8063
No log	0.7311	386	0.5801	0.5448	0.5801	0.7616
No log	0.7348	388	0.5229	0.6038	0.5229	0.7231
No log	0.7386	390	0.5281	0.5939	0.5281	0.7267
No log	0.7424	392	0.5973	0.5541	0.5973	0.7729
No log	0.7462	394	0.5511	0.5834	0.5511	0.7424
No log	0.75	396	0.5402	0.6069	0.5402	0.7350
No log	0.7538	398	0.5426	0.5919	0.5426	0.7366
No log	0.7576	400	0.6118	0.5280	0.6118	0.7822
No log	0.7614	402	0.6589	0.5151	0.6589	0.8117
No log	0.7652	404	0.5476	0.5864	0.5476	0.7400
No log	0.7689	406	0.6422	0.5091	0.6422	0.8014
No log	0.7727	408	0.6365	0.5034	0.6365	0.7978
No log	0.7765	410	0.5469	0.5709	0.5469	0.7396
No log	0.7803	412	0.5964	0.5283	0.5964	0.7723
No log	0.7841	414	0.5603	0.5643	0.5603	0.7485
No log	0.7879	416	0.5408	0.5593	0.5408	0.7354
No log	0.7917	418	0.5518	0.5738	0.5518	0.7429
No log	0.7955	420	0.5583	0.5963	0.5583	0.7472
No log	0.7992	422	0.5822	0.5843	0.5822	0.7630
No log	0.8030	424	0.5855	0.6036	0.5855	0.7652
No log	0.8068	426	0.5293	0.5764	0.5293	0.7275
No log	0.8106	428	0.5217	0.5737	0.5217	0.7223
No log	0.8144	430	0.5274	0.5850	0.5274	0.7262
No log	0.8182	432	0.5836	0.5892	0.5836	0.7640
No log	0.8220	434	0.5107	0.5806	0.5107	0.7146
No log	0.8258	436	0.5480	0.5514	0.5480	0.7403
No log	0.8295	438	0.5255	0.5438	0.5255	0.7249
No log	0.8333	440	0.6415	0.5417	0.6415	0.8009
No log	0.8371	442	0.8021	0.4850	0.8021	0.8956
No log	0.8409	444	0.6858	0.4837	0.6858	0.8281
No log	0.8447	446	0.6999	0.4757	0.6999	0.8366
No log	0.8485	448	0.6373	0.4777	0.6373	0.7983
No log	0.8523	450	0.6190	0.4825	0.6190	0.7867
No log	0.8561	452	0.7866	0.4403	0.7866	0.8869
No log	0.8598	454	1.0436	0.4050	1.0436	1.0216
No log	0.8636	456	0.8495	0.4488	0.8495	0.9217
No log	0.8674	458	0.5716	0.5079	0.5716	0.7561
No log	0.8712	460	0.5739	0.5402	0.5739	0.7575
No log	0.875	462	0.5633	0.5078	0.5633	0.7505
No log	0.8788	464	0.7712	0.4923	0.7712	0.8782
No log	0.8826	466	0.8337	0.4752	0.8337	0.9131
No log	0.8864	468	0.6344	0.5112	0.6344	0.7965
No log	0.8902	470	0.5835	0.5110	0.5835	0.7639
No log	0.8939	472	0.5565	0.5437	0.5565	0.7460
No log	0.8977	474	0.5884	0.5547	0.5884	0.7671
No log	0.9015	476	0.6191	0.5502	0.6191	0.7868
No log	0.9053	478	0.5493	0.5563	0.5493	0.7412
No log	0.9091	480	0.5342	0.5742	0.5342	0.7309
No log	0.9129	482	0.5339	0.5661	0.5339	0.7307
No log	0.9167	484	0.5663	0.5367	0.5663	0.7525
No log	0.9205	486	0.5356	0.5622	0.5356	0.7319
No log	0.9242	488	0.5063	0.5726	0.5063	0.7115
No log	0.9280	490	0.5410	0.5609	0.5410	0.7355
No log	0.9318	492	0.5177	0.5724	0.5177	0.7195
No log	0.9356	494	0.5363	0.5926	0.5363	0.7324
No log	0.9394	496	0.5324	0.5926	0.5324	0.7296
No log	0.9432	498	0.5102	0.5876	0.5102	0.7143
0.8938	0.9470	500	0.5140	0.5738	0.5140	0.7170
0.8938	0.9508	502	0.5073	0.6103	0.5073	0.7123
0.8938	0.9545	504	0.6312	0.5725	0.6312	0.7945
0.8938	0.9583	506	0.5980	0.5851	0.5980	0.7733
0.8938	0.9621	508	0.5288	0.6057	0.5288	0.7272
0.8938	0.9659	510	0.5498	0.5742	0.5498	0.7415
0.8938	0.9697	512	0.6136	0.5472	0.6136	0.7834
0.8938	0.9735	514	0.6480	0.5379	0.6480	0.8050
0.8938	0.9773	516	0.7025	0.5257	0.7025	0.8382
0.8938	0.9811	518	0.7165	0.5232	0.7165	0.8464
0.8938	0.9848	520	0.5973	0.5540	0.5973	0.7728

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
License: apache-2.0
Created: Nov 18, 2024
Updated: Nov 24, 2024