ASAP_FineTuningBERT_AugV4_k4_task1_organization_fold3

MayBashendy/ASAP_FineTuningBERT_AugV4_k4_task1_organization_fold3

ASAP_FineTuningBERT_AugV4_k4_task1_organization_fold3 is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

24% of all-time downloads

All-time downloads

Public

Parameters

109M

876 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors438 MB · 100%

At a glance

Task: Text Classification
Library: transformers
License: apache-2.0
Model type: bert
Access: Public
Created: Nov 18, 2024
Updated: Nov 24, 2024
SHA: fd472c95

Try a prompt

Base models

Model card

From the Hugging Face model README

ASAP_FineTuningBERT_AugV4_k4_task1_organization_fold3

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.6991
Qwk: 0.6057
Mse: 0.6991
Rmse: 0.8361

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 32
eval_batch_size: 32
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0048	2	12.1503	0.0023	12.1503	3.4857
No log	0.0095	4	11.0481	0.0099	11.0481	3.3239
No log	0.0143	6	9.0791	0.0018	9.0791	3.0132
No log	0.0190	8	7.4813	0.0	7.4813	2.7352
No log	0.0238	10	6.5906	0.0013	6.5906	2.5672
No log	0.0285	12	5.5964	0.0240	5.5964	2.3657
No log	0.0333	14	4.3752	0.0076	4.3752	2.0917
No log	0.0380	16	3.8585	0.0076	3.8585	1.9643
No log	0.0428	18	3.3000	0.0076	3.3000	1.8166
No log	0.0475	20	2.5740	0.0831	2.5740	1.6044
No log	0.0523	22	2.1271	0.0431	2.1271	1.4585
No log	0.0570	24	1.6494	0.0202	1.6494	1.2843
No log	0.0618	26	1.2823	0.0202	1.2823	1.1324
No log	0.0665	28	1.0167	0.0202	1.0167	1.0083
No log	0.0713	30	0.9196	0.2220	0.9196	0.9590
No log	0.0760	32	0.8467	0.0623	0.8467	0.9202
No log	0.0808	34	0.8492	0.0623	0.8492	0.9215
No log	0.0855	36	0.9037	0.0314	0.9037	0.9507
No log	0.0903	38	1.1507	0.0314	1.1507	1.0727
No log	0.0950	40	1.2302	0.0348	1.2302	1.1092
No log	0.0998	42	0.9026	0.0314	0.9026	0.9500
No log	0.1045	44	0.9244	0.2225	0.9244	0.9615
No log	0.1093	46	0.8182	0.0867	0.8182	0.9046
No log	0.1140	48	0.8476	0.0736	0.8476	0.9207
No log	0.1188	50	0.7608	0.2018	0.7608	0.8722
No log	0.1235	52	0.7359	0.2720	0.7359	0.8579
No log	0.1283	54	0.7361	0.3124	0.7361	0.8579
No log	0.1330	56	0.7472	0.1891	0.7472	0.8644
No log	0.1378	58	0.8829	0.1940	0.8829	0.9397
No log	0.1425	60	0.7626	0.1355	0.7626	0.8733
No log	0.1473	62	0.6908	0.2354	0.6908	0.8311
No log	0.1520	64	0.6315	0.3194	0.6315	0.7947
No log	0.1568	66	0.6008	0.3492	0.6008	0.7751
No log	0.1615	68	0.5996	0.3714	0.5996	0.7743
No log	0.1663	70	0.7326	0.4130	0.7326	0.8559
No log	0.1710	72	0.6285	0.3506	0.6285	0.7928
No log	0.1758	74	0.6445	0.3914	0.6445	0.8028
No log	0.1805	76	0.6134	0.4473	0.6134	0.7832
No log	0.1853	78	0.6487	0.4158	0.6487	0.8054
No log	0.1900	80	0.6270	0.4902	0.6270	0.7918
No log	0.1948	82	0.6386	0.4710	0.6386	0.7991
No log	0.1995	84	0.6675	0.4684	0.6675	0.8170
No log	0.2043	86	0.9009	0.3333	0.9009	0.9492
No log	0.2090	88	0.7979	0.4251	0.7979	0.8932
No log	0.2138	90	0.6890	0.4514	0.6890	0.8300
No log	0.2185	92	0.7512	0.4365	0.7512	0.8667
No log	0.2233	94	0.6479	0.4245	0.6479	0.8049
No log	0.2280	96	0.6591	0.3643	0.6591	0.8119
No log	0.2328	98	0.6557	0.3798	0.6557	0.8098
No log	0.2375	100	0.9491	0.3912	0.9491	0.9742
No log	0.2423	102	0.9285	0.3934	0.9285	0.9636
No log	0.2470	104	0.6809	0.4622	0.6809	0.8252
No log	0.2518	106	0.6386	0.4795	0.6386	0.7991
No log	0.2565	108	0.6997	0.4579	0.6997	0.8365
No log	0.2613	110	0.6543	0.5045	0.6543	0.8089
No log	0.2660	112	0.9048	0.3750	0.9048	0.9512
No log	0.2708	114	1.0620	0.3069	1.0620	1.0305
No log	0.2755	116	1.0310	0.2922	1.0310	1.0154
No log	0.2803	118	1.0382	0.2909	1.0382	1.0189
No log	0.2850	120	0.9695	0.3381	0.9695	0.9846
No log	0.2898	122	0.8457	0.3844	0.8457	0.9196
No log	0.2945	124	0.7668	0.4393	0.7668	0.8756
No log	0.2993	126	0.8015	0.4499	0.8015	0.8953
No log	0.3040	128	0.5596	0.5395	0.5596	0.7481
No log	0.3088	130	0.6800	0.4951	0.6800	0.8246
No log	0.3135	132	0.6596	0.4825	0.6596	0.8122
No log	0.3183	134	0.5470	0.5577	0.5470	0.7396
No log	0.3230	136	0.5932	0.5661	0.5932	0.7702
No log	0.3278	138	0.5511	0.5790	0.5511	0.7424
No log	0.3325	140	0.5491	0.5641	0.5491	0.7410
No log	0.3373	142	0.5444	0.5825	0.5444	0.7378
No log	0.3420	144	0.6245	0.5471	0.6245	0.7902
No log	0.3468	146	0.7777	0.5151	0.7777	0.8819
No log	0.3515	148	0.9213	0.4735	0.9213	0.9598
No log	0.3563	150	0.8635	0.4928	0.8635	0.9292
No log	0.3610	152	0.6761	0.5447	0.6761	0.8223
No log	0.3658	154	0.5357	0.5768	0.5357	0.7319
No log	0.3705	156	0.5365	0.5860	0.5365	0.7325
No log	0.3753	158	0.6922	0.5015	0.6922	0.8320
No log	0.3800	160	0.7024	0.5000	0.7024	0.8381
No log	0.3848	162	0.5197	0.5876	0.5197	0.7209
No log	0.3895	164	0.5869	0.4937	0.5869	0.7661
No log	0.3943	166	0.5612	0.5415	0.5612	0.7491
No log	0.3990	168	0.5440	0.5986	0.5440	0.7375
No log	0.4038	170	0.5620	0.6061	0.5620	0.7497
No log	0.4086	172	0.5820	0.5993	0.5820	0.7629
No log	0.4133	174	0.5361	0.6105	0.5361	0.7322
No log	0.4181	176	0.5471	0.5984	0.5471	0.7397
No log	0.4228	178	0.5228	0.5845	0.5228	0.7231
No log	0.4276	180	0.5233	0.5807	0.5233	0.7234
No log	0.4323	182	0.6492	0.5474	0.6492	0.8057
No log	0.4371	184	0.8715	0.4276	0.8715	0.9335
No log	0.4418	186	0.9170	0.4232	0.9170	0.9576
No log	0.4466	188	0.6264	0.5124	0.6264	0.7914
No log	0.4513	190	0.5403	0.5395	0.5403	0.7350
No log	0.4561	192	0.5247	0.5233	0.5247	0.7243
No log	0.4608	194	0.5335	0.5737	0.5335	0.7304
No log	0.4656	196	0.5968	0.5489	0.5968	0.7725
No log	0.4703	198	0.5947	0.5457	0.5947	0.7711
No log	0.4751	200	0.5196	0.5755	0.5196	0.7209
No log	0.4798	202	0.5101	0.5772	0.5101	0.7142
No log	0.4846	204	0.5115	0.5683	0.5115	0.7152
No log	0.4893	206	0.5438	0.5478	0.5438	0.7374
No log	0.4941	208	0.5239	0.5671	0.5239	0.7238
No log	0.4988	210	0.5161	0.5683	0.5161	0.7184
No log	0.5036	212	0.5537	0.5426	0.5537	0.7441
No log	0.5083	214	0.5822	0.5482	0.5822	0.7630
No log	0.5131	216	0.5351	0.5817	0.5351	0.7315
No log	0.5178	218	0.5633	0.5737	0.5633	0.7505
No log	0.5226	220	0.6283	0.5460	0.6283	0.7926
No log	0.5273	222	0.5803	0.5803	0.5803	0.7618
No log	0.5321	224	0.6079	0.5752	0.6079	0.7797
No log	0.5368	226	0.7510	0.5237	0.7510	0.8666
No log	0.5416	228	0.7706	0.5113	0.7706	0.8779
No log	0.5463	230	0.6130	0.5573	0.6130	0.7830
No log	0.5511	232	0.5448	0.5789	0.5448	0.7381
No log	0.5558	234	0.5387	0.5616	0.5387	0.7340
No log	0.5606	236	0.5109	0.5885	0.5109	0.7148
No log	0.5653	238	0.5162	0.5469	0.5162	0.7185
No log	0.5701	240	0.6837	0.5369	0.6837	0.8268
No log	0.5748	242	0.8818	0.4574	0.8818	0.9391
No log	0.5796	244	0.7028	0.5198	0.7028	0.8383
No log	0.5843	246	0.5567	0.5143	0.5567	0.7461
No log	0.5891	248	0.5596	0.5266	0.5596	0.7480
No log	0.5938	250	0.6957	0.5526	0.6957	0.8341
No log	0.5986	252	0.7775	0.5294	0.7775	0.8818
No log	0.6033	254	0.6095	0.5708	0.6095	0.7807
No log	0.6081	256	0.5416	0.5629	0.5416	0.7359
No log	0.6128	258	0.5396	0.5816	0.5396	0.7346
No log	0.6176	260	0.5549	0.5719	0.5549	0.7449
No log	0.6223	262	0.6289	0.5769	0.6289	0.7930
No log	0.6271	264	0.5858	0.5397	0.5858	0.7654
No log	0.6318	266	0.6379	0.5294	0.6379	0.7987
No log	0.6366	268	0.6983	0.5190	0.6983	0.8356
No log	0.6413	270	0.9660	0.4489	0.9660	0.9828
No log	0.6461	272	0.9920	0.4533	0.9920	0.9960
No log	0.6508	274	0.6736	0.5317	0.6736	0.8207
No log	0.6556	276	0.5818	0.5439	0.5818	0.7628
No log	0.6603	278	0.5843	0.5225	0.5843	0.7644
No log	0.6651	280	0.5605	0.5477	0.5605	0.7487
No log	0.6698	282	0.6963	0.5182	0.6963	0.8344
No log	0.6746	284	0.6066	0.5714	0.6066	0.7788
No log	0.6793	286	0.5114	0.5998	0.5114	0.7151
No log	0.6841	288	0.5499	0.5656	0.5499	0.7416
No log	0.6888	290	0.5407	0.5866	0.5407	0.7353
No log	0.6936	292	0.5490	0.5962	0.5490	0.7410
No log	0.6983	294	0.5891	0.6018	0.5891	0.7676
No log	0.7031	296	0.7656	0.5466	0.7656	0.8750
No log	0.7078	298	0.7115	0.5602	0.7115	0.8435
No log	0.7126	300	0.6260	0.5890	0.6260	0.7912
No log	0.7173	302	0.5525	0.5603	0.5525	0.7433
No log	0.7221	304	0.5820	0.5754	0.5820	0.7629
No log	0.7268	306	0.6271	0.5781	0.6271	0.7919
No log	0.7316	308	0.5334	0.5493	0.5334	0.7303
No log	0.7363	310	0.5419	0.5268	0.5419	0.7361
No log	0.7411	312	0.5346	0.5344	0.5346	0.7312
No log	0.7458	314	0.5945	0.6096	0.5945	0.7711
No log	0.7506	316	0.7176	0.5904	0.7176	0.8471
No log	0.7553	318	0.5513	0.6266	0.5513	0.7425
No log	0.7601	320	0.5128	0.5950	0.5128	0.7161
No log	0.7648	322	0.5655	0.5846	0.5655	0.7520
No log	0.7696	324	0.5240	0.5899	0.5240	0.7239
No log	0.7743	326	0.7023	0.5698	0.7023	0.8380
No log	0.7791	328	0.6656	0.5898	0.6656	0.8159
No log	0.7838	330	0.5664	0.5871	0.5664	0.7526
No log	0.7886	332	0.6157	0.5860	0.6157	0.7847
No log	0.7933	334	0.7392	0.5397	0.7392	0.8598
No log	0.7981	336	0.6137	0.5998	0.6137	0.7834
No log	0.8029	338	0.5748	0.6222	0.5748	0.7581
No log	0.8076	340	0.5300	0.6077	0.5300	0.7280
No log	0.8124	342	0.5424	0.6186	0.5424	0.7365
No log	0.8171	344	0.5674	0.6451	0.5674	0.7533
No log	0.8219	346	0.5705	0.6170	0.5705	0.7553
No log	0.8266	348	0.6270	0.5661	0.6270	0.7919
No log	0.8314	350	0.6201	0.5384	0.6201	0.7874
No log	0.8361	352	0.5214	0.6189	0.5214	0.7221
No log	0.8409	354	0.7790	0.5362	0.7790	0.8826
No log	0.8456	356	0.8630	0.5051	0.8630	0.9290
No log	0.8504	358	0.6560	0.5746	0.6560	0.8099
No log	0.8551	360	0.6343	0.5597	0.6343	0.7964
No log	0.8599	362	0.6900	0.5532	0.6900	0.8307
No log	0.8646	364	0.7280	0.5239	0.7280	0.8532
No log	0.8694	366	0.8799	0.4753	0.8799	0.9380
No log	0.8741	368	0.8059	0.4997	0.8059	0.8977
No log	0.8789	370	0.5579	0.5611	0.5579	0.7469
No log	0.8836	372	0.5213	0.5686	0.5213	0.7220
No log	0.8884	374	0.5175	0.5705	0.5175	0.7193
No log	0.8931	376	0.5263	0.6002	0.5263	0.7255
No log	0.8979	378	0.5862	0.5737	0.5862	0.7656
No log	0.9026	380	0.5873	0.5773	0.5873	0.7663
No log	0.9074	382	0.5192	0.5742	0.5192	0.7206
No log	0.9121	384	0.5353	0.5723	0.5353	0.7317
No log	0.9169	386	0.5213	0.5990	0.5213	0.7220
No log	0.9216	388	0.5896	0.5834	0.5896	0.7679
No log	0.9264	390	0.7697	0.5373	0.7697	0.8773
No log	0.9311	392	0.7164	0.5568	0.7164	0.8464
No log	0.9359	394	0.5637	0.5946	0.5637	0.7508
No log	0.9406	396	0.5362	0.6010	0.5362	0.7323
No log	0.9454	398	0.5434	0.5810	0.5434	0.7371
No log	0.9501	400	0.6429	0.5530	0.6429	0.8018
No log	0.9549	402	0.9170	0.4726	0.9170	0.9576
No log	0.9596	404	0.8541	0.4927	0.8541	0.9242
No log	0.9644	406	0.6047	0.5198	0.6047	0.7776
No log	0.9691	408	0.5433	0.5672	0.5433	0.7371
No log	0.9739	410	0.5462	0.5565	0.5462	0.7391
No log	0.9786	412	0.5936	0.5184	0.5936	0.7705
No log	0.9834	414	0.6514	0.5008	0.6514	0.8071
No log	0.9881	416	0.6009	0.5221	0.6009	0.7752
No log	0.9929	418	0.5528	0.5732	0.5528	0.7435
No log	0.9976	420	0.5812	0.5526	0.5812	0.7624
No log	1.0024	422	0.6889	0.5188	0.6889	0.8300
No log	1.0071	424	0.6380	0.5403	0.6380	0.7988
No log	1.0119	426	0.5582	0.5683	0.5582	0.7471
No log	1.0166	428	0.5758	0.5720	0.5758	0.7588
No log	1.0214	430	0.5991	0.5944	0.5991	0.7740
No log	1.0261	432	0.5858	0.6053	0.5858	0.7654
No log	1.0309	434	0.5552	0.6134	0.5552	0.7451
No log	1.0356	436	0.5671	0.6030	0.5671	0.7530
No log	1.0404	438	0.6008	0.5422	0.6008	0.7751
No log	1.0451	440	0.5980	0.5216	0.5980	0.7733
No log	1.0499	442	0.5977	0.5210	0.5977	0.7731
No log	1.0546	444	0.6791	0.5069	0.6791	0.8241
No log	1.0594	446	0.6943	0.5024	0.6943	0.8333
No log	1.0641	448	0.6093	0.5253	0.6093	0.7805
No log	1.0689	450	0.5582	0.5363	0.5582	0.7471
No log	1.0736	452	0.5694	0.5289	0.5694	0.7546
No log	1.0784	454	0.6338	0.5316	0.6338	0.7961
No log	1.0831	456	0.6122	0.5351	0.6122	0.7824
No log	1.0879	458	0.5802	0.5276	0.5802	0.7617
No log	1.0926	460	0.5859	0.5633	0.5859	0.7654
No log	1.0974	462	0.6498	0.5463	0.6498	0.8061
No log	1.1021	464	0.6043	0.5542	0.6043	0.7774
No log	1.1069	466	0.5516	0.5799	0.5516	0.7427
No log	1.1116	468	0.5758	0.5377	0.5758	0.7588
No log	1.1164	470	0.5437	0.5899	0.5437	0.7374
No log	1.1211	472	0.6171	0.5980	0.6171	0.7856
No log	1.1259	474	0.5814	0.6191	0.5814	0.7625
No log	1.1306	476	0.5520	0.5932	0.5520	0.7430
No log	1.1354	478	0.5666	0.5967	0.5666	0.7527
No log	1.1401	480	0.6001	0.6036	0.6001	0.7747
No log	1.1449	482	0.6719	0.5954	0.6719	0.8197
No log	1.1496	484	0.7078	0.5787	0.7078	0.8413
No log	1.1544	486	0.6175	0.6046	0.6175	0.7858
No log	1.1591	488	0.6018	0.6101	0.6018	0.7757
No log	1.1639	490	0.5166	0.6321	0.5166	0.7187
No log	1.1686	492	0.5209	0.6202	0.5209	0.7217
No log	1.1734	494	0.5586	0.6480	0.5586	0.7474
No log	1.1781	496	0.7894	0.5495	0.7894	0.8885
No log	1.1829	498	0.7686	0.5493	0.7686	0.8767
0.9787	1.1876	500	0.5730	0.6390	0.5730	0.7570
0.9787	1.1924	502	0.5823	0.5707	0.5823	0.7631
0.9787	1.1971	504	0.5936	0.5671	0.5936	0.7704
0.9787	1.2019	506	0.5364	0.6206	0.5364	0.7324
0.9787	1.2067	508	0.6693	0.6163	0.6693	0.8181
0.9787	1.2114	510	0.6991	0.6057	0.6991	0.8361

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
License: apache-2.0
Created: Nov 18, 2024
Updated: Nov 24, 2024