ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k10_task1_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k10_task1_organization

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k10_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

59% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: e4f8f775

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run3_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7348
Qwk: 0.6560
Mse: 0.7348
Rmse: 0.8572

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0417	2	5.2603	-0.0152	5.2603	2.2935
No log	0.0833	4	3.1913	0.0987	3.1913	1.7864
No log	0.125	6	2.2365	-0.0123	2.2365	1.4955
No log	0.1667	8	2.1205	-0.0293	2.1205	1.4562
No log	0.2083	10	2.0615	-0.0706	2.0615	1.4358
No log	0.25	12	1.5787	-0.0368	1.5787	1.2565
No log	0.2917	14	1.4261	-0.0384	1.4261	1.1942
No log	0.3333	16	1.5815	0.0196	1.5815	1.2576
No log	0.375	18	1.5676	0.0277	1.5676	1.2520
No log	0.4167	20	1.3249	0.1101	1.3249	1.1510
No log	0.4583	22	1.3054	0.1281	1.3054	1.1426
No log	0.5	24	1.3433	0.0947	1.3433	1.1590
No log	0.5417	26	1.3486	0.1174	1.3486	1.1613
No log	0.5833	28	1.3803	0.0391	1.3803	1.1749
No log	0.625	30	1.4037	0.0720	1.4037	1.1848
No log	0.6667	32	1.3385	0.1420	1.3385	1.1569
No log	0.7083	34	1.1811	0.2161	1.1811	1.0868
No log	0.75	36	1.1301	0.3102	1.1301	1.0631
No log	0.7917	38	1.1799	0.3098	1.1799	1.0862
No log	0.8333	40	1.2420	0.2414	1.2420	1.1144
No log	0.875	42	1.2133	0.2930	1.2133	1.1015
No log	0.9167	44	1.1855	0.3169	1.1855	1.0888
No log	0.9583	46	1.1417	0.3218	1.1417	1.0685
No log	1.0	48	1.2012	0.2676	1.2012	1.0960
No log	1.0417	50	1.2247	0.2250	1.2247	1.1067
No log	1.0833	52	1.1741	0.2485	1.1741	1.0835
No log	1.125	54	1.2239	0.1686	1.2239	1.1063
No log	1.1667	56	1.2388	0.1686	1.2388	1.1130
No log	1.2083	58	1.2229	0.1758	1.2229	1.1059
No log	1.25	60	1.0931	0.2363	1.0931	1.0455
No log	1.2917	62	1.0342	0.2826	1.0342	1.0170
No log	1.3333	64	0.9594	0.3723	0.9594	0.9795
No log	1.375	66	0.8943	0.3890	0.8943	0.9457
No log	1.4167	68	0.8806	0.3942	0.8806	0.9384
No log	1.4583	70	0.9014	0.4347	0.9014	0.9494
No log	1.5	72	0.9835	0.4230	0.9835	0.9917
No log	1.5417	74	0.8881	0.4872	0.8881	0.9424
No log	1.5833	76	0.7925	0.4461	0.7925	0.8902
No log	1.625	78	0.8380	0.4623	0.8380	0.9154
No log	1.6667	80	0.9072	0.4299	0.9072	0.9525
No log	1.7083	82	0.7837	0.5960	0.7837	0.8853
No log	1.75	84	0.7718	0.5701	0.7718	0.8785
No log	1.7917	86	0.8775	0.5593	0.8775	0.9368
No log	1.8333	88	0.7773	0.5846	0.7773	0.8816
No log	1.875	90	0.6530	0.6309	0.6530	0.8081
No log	1.9167	92	0.6097	0.6523	0.6097	0.7809
No log	1.9583	94	0.5869	0.6959	0.5869	0.7661
No log	2.0	96	0.6100	0.7281	0.6100	0.7810
No log	2.0417	98	0.6457	0.7058	0.6457	0.8036
No log	2.0833	100	0.7501	0.6867	0.7501	0.8661
No log	2.125	102	0.6583	0.6963	0.6583	0.8113
No log	2.1667	104	0.5491	0.7183	0.5491	0.7410
No log	2.2083	106	0.5574	0.7188	0.5574	0.7466
No log	2.25	108	0.5702	0.7211	0.5702	0.7551
No log	2.2917	110	0.6213	0.7289	0.6213	0.7882
No log	2.3333	112	0.7382	0.6901	0.7382	0.8592
No log	2.375	114	0.8625	0.5939	0.8625	0.9287
No log	2.4167	116	0.8804	0.5939	0.8804	0.9383
No log	2.4583	118	0.8498	0.6293	0.8498	0.9219
No log	2.5	120	1.0146	0.5875	1.0146	1.0073
No log	2.5417	122	1.2710	0.5065	1.2710	1.1274
No log	2.5833	124	1.2032	0.5367	1.2032	1.0969
No log	2.625	126	0.9843	0.6239	0.9843	0.9921
No log	2.6667	128	0.9619	0.6376	0.9619	0.9808
No log	2.7083	130	1.1198	0.5659	1.1198	1.0582
No log	2.75	132	1.2436	0.5453	1.2436	1.1152
No log	2.7917	134	1.1504	0.5849	1.1504	1.0726
No log	2.8333	136	0.9653	0.6161	0.9653	0.9825
No log	2.875	138	0.8041	0.6343	0.8041	0.8967
No log	2.9167	140	0.8205	0.6326	0.8205	0.9058
No log	2.9583	142	0.9523	0.6011	0.9523	0.9758
No log	3.0	144	1.0772	0.5947	1.0772	1.0379
No log	3.0417	146	1.0532	0.5959	1.0532	1.0263
No log	3.0833	148	0.9379	0.6060	0.9379	0.9685
No log	3.125	150	0.8300	0.5886	0.8300	0.9110
No log	3.1667	152	0.7448	0.6328	0.7448	0.8630
No log	3.2083	154	0.7162	0.6306	0.7162	0.8463
No log	3.25	156	0.7469	0.6476	0.7469	0.8643
No log	3.2917	158	0.8523	0.6018	0.8523	0.9232
No log	3.3333	160	0.8841	0.6002	0.8841	0.9403
No log	3.375	162	0.8358	0.6252	0.8358	0.9142
No log	3.4167	164	0.7477	0.6733	0.7477	0.8647
No log	3.4583	166	0.7560	0.6782	0.7560	0.8695
No log	3.5	168	0.7515	0.6834	0.7515	0.8669
No log	3.5417	170	0.8099	0.6448	0.8099	0.8999
No log	3.5833	172	0.9312	0.5989	0.9312	0.9650
No log	3.625	174	1.0542	0.5918	1.0542	1.0267
No log	3.6667	176	1.0115	0.6025	1.0115	1.0058
No log	3.7083	178	0.8312	0.6350	0.8312	0.9117
No log	3.75	180	0.7124	0.6712	0.7124	0.8441
No log	3.7917	182	0.6868	0.7217	0.6868	0.8287
No log	3.8333	184	0.6961	0.6664	0.6961	0.8343
No log	3.875	186	0.7242	0.6708	0.7242	0.8510
No log	3.9167	188	0.7145	0.6681	0.7145	0.8453
No log	3.9583	190	0.7119	0.6715	0.7119	0.8437
No log	4.0	192	0.6642	0.7091	0.6642	0.8150
No log	4.0417	194	0.6497	0.7217	0.6497	0.8060
No log	4.0833	196	0.6576	0.7163	0.6576	0.8110
No log	4.125	198	0.6668	0.7138	0.6668	0.8166
No log	4.1667	200	0.6840	0.6966	0.6840	0.8270
No log	4.2083	202	0.7240	0.6732	0.7240	0.8509
No log	4.25	204	0.6902	0.6994	0.6902	0.8308
No log	4.2917	206	0.6696	0.7127	0.6696	0.8183
No log	4.3333	208	0.6797	0.7009	0.6797	0.8244
No log	4.375	210	0.7607	0.6713	0.7607	0.8722
No log	4.4167	212	0.8237	0.6439	0.8237	0.9076
No log	4.4583	214	0.8286	0.6574	0.8286	0.9103
No log	4.5	216	0.8397	0.6642	0.8397	0.9163
No log	4.5417	218	0.7831	0.6548	0.7831	0.8850
No log	4.5833	220	0.7737	0.6516	0.7737	0.8796
No log	4.625	222	0.7345	0.6738	0.7345	0.8571
No log	4.6667	224	0.7412	0.6783	0.7412	0.8609
No log	4.7083	226	0.8022	0.6457	0.8022	0.8957
No log	4.75	228	0.8948	0.6469	0.8948	0.9459
No log	4.7917	230	0.9369	0.6433	0.9369	0.9679
No log	4.8333	232	0.8499	0.6446	0.8499	0.9219
No log	4.875	234	0.7276	0.6938	0.7276	0.8530
No log	4.9167	236	0.6908	0.7156	0.6908	0.8311
No log	4.9583	238	0.6847	0.7066	0.6847	0.8275
No log	5.0	240	0.6770	0.7166	0.6770	0.8228
No log	5.0417	242	0.6915	0.7199	0.6915	0.8316
No log	5.0833	244	0.7452	0.6605	0.7452	0.8633
No log	5.125	246	0.7710	0.6391	0.7710	0.8781
No log	5.1667	248	0.7297	0.6918	0.7297	0.8542
No log	5.2083	250	0.6778	0.7245	0.6778	0.8233
No log	5.25	252	0.6691	0.7211	0.6691	0.8180
No log	5.2917	254	0.6729	0.7284	0.6729	0.8203
No log	5.3333	256	0.7023	0.6756	0.7023	0.8380
No log	5.375	258	0.7578	0.6846	0.7578	0.8705
No log	5.4167	260	0.7931	0.6631	0.7931	0.8905
No log	5.4583	262	0.8361	0.6218	0.8361	0.9144
No log	5.5	264	0.8201	0.6246	0.8201	0.9056
No log	5.5417	266	0.8043	0.6364	0.8043	0.8968
No log	5.5833	268	0.7812	0.6393	0.7812	0.8838
No log	5.625	270	0.8097	0.6393	0.8097	0.8998
No log	5.6667	272	0.8519	0.6376	0.8519	0.9230
No log	5.7083	274	0.8676	0.6466	0.8676	0.9314
No log	5.75	276	0.8987	0.6395	0.8987	0.9480
No log	5.7917	278	0.9238	0.6502	0.9238	0.9611
No log	5.8333	280	0.9043	0.6306	0.9043	0.9510
No log	5.875	282	0.8483	0.6474	0.8483	0.9210
No log	5.9167	284	0.8335	0.6334	0.8335	0.9130
No log	5.9583	286	0.8321	0.6334	0.8321	0.9122
No log	6.0	288	0.8050	0.6349	0.8050	0.8972
No log	6.0417	290	0.7878	0.6444	0.7878	0.8876
No log	6.0833	292	0.7356	0.6609	0.7356	0.8577
No log	6.125	294	0.7115	0.6628	0.7115	0.8435
No log	6.1667	296	0.7111	0.6647	0.7111	0.8433
No log	6.2083	298	0.7344	0.6609	0.7344	0.8570
No log	6.25	300	0.7797	0.6666	0.7797	0.8830
No log	6.2917	302	0.8709	0.6417	0.8709	0.9332
No log	6.3333	304	0.9043	0.6536	0.9043	0.9509
No log	6.375	306	0.8703	0.6415	0.8703	0.9329
No log	6.4167	308	0.8008	0.6627	0.8008	0.8949
No log	6.4583	310	0.7349	0.6722	0.7349	0.8572
No log	6.5	312	0.6988	0.6750	0.6988	0.8360
No log	6.5417	314	0.6896	0.7219	0.6896	0.8304
No log	6.5833	316	0.6961	0.7048	0.6961	0.8343
No log	6.625	318	0.7169	0.6581	0.7169	0.8467
No log	6.6667	320	0.7747	0.6357	0.7747	0.8802
No log	6.7083	322	0.8625	0.6552	0.8625	0.9287
No log	6.75	324	0.9154	0.6285	0.9154	0.9567
No log	6.7917	326	0.8999	0.6374	0.8999	0.9486
No log	6.8333	328	0.8256	0.6524	0.8256	0.9086
No log	6.875	330	0.7551	0.6655	0.7551	0.8690
No log	6.9167	332	0.7409	0.6510	0.7409	0.8608
No log	6.9583	334	0.7305	0.6623	0.7305	0.8547
No log	7.0	336	0.7184	0.6623	0.7184	0.8476
No log	7.0417	338	0.7281	0.6607	0.7281	0.8533
No log	7.0833	340	0.7572	0.6535	0.7572	0.8702
No log	7.125	342	0.7764	0.6598	0.7764	0.8812
No log	7.1667	344	0.8335	0.6655	0.8335	0.9129
No log	7.2083	346	0.8795	0.6623	0.8795	0.9378
No log	7.25	348	0.8729	0.6766	0.8729	0.9343
No log	7.2917	350	0.8255	0.6664	0.8255	0.9086
No log	7.3333	352	0.7842	0.6617	0.7842	0.8855
No log	7.375	354	0.7475	0.6535	0.7475	0.8646
No log	7.4167	356	0.7289	0.6523	0.7289	0.8538
No log	7.4583	358	0.7204	0.6523	0.7204	0.8487
No log	7.5	360	0.7442	0.6535	0.7442	0.8627
No log	7.5417	362	0.8027	0.6688	0.8027	0.8960
No log	7.5833	364	0.8554	0.6651	0.8554	0.9249
No log	7.625	366	0.8471	0.6766	0.8471	0.9204
No log	7.6667	368	0.8030	0.6645	0.8030	0.8961
No log	7.7083	370	0.7310	0.6535	0.7310	0.8550
No log	7.75	372	0.6921	0.6859	0.6921	0.8319
No log	7.7917	374	0.6725	0.7326	0.6725	0.8201
No log	7.8333	376	0.6811	0.7078	0.6811	0.8253
No log	7.875	378	0.7070	0.6781	0.7070	0.8408
No log	7.9167	380	0.7498	0.6607	0.7498	0.8659
No log	7.9583	382	0.7788	0.6688	0.7788	0.8825
No log	8.0	384	0.7886	0.6749	0.7886	0.8880
No log	8.0417	386	0.7829	0.6749	0.7829	0.8848
No log	8.0833	388	0.7997	0.6833	0.7997	0.8943
No log	8.125	390	0.7885	0.6863	0.7885	0.8880
No log	8.1667	392	0.7487	0.6631	0.7487	0.8653
No log	8.2083	394	0.7105	0.6719	0.7105	0.8429
No log	8.25	396	0.6909	0.7243	0.6909	0.8312
No log	8.2917	398	0.6929	0.7027	0.6929	0.8324
No log	8.3333	400	0.7125	0.6713	0.7125	0.8441
No log	8.375	402	0.7411	0.6676	0.7411	0.8609
No log	8.4167	404	0.7863	0.6643	0.7863	0.8867
No log	8.4583	406	0.8306	0.6674	0.8306	0.9114
No log	8.5	408	0.8359	0.6674	0.8359	0.9143
No log	8.5417	410	0.8209	0.6613	0.8209	0.9060
No log	8.5833	412	0.7963	0.6599	0.7963	0.8924
No log	8.625	414	0.7823	0.6599	0.7823	0.8845
No log	8.6667	416	0.7613	0.6607	0.7613	0.8725
No log	8.7083	418	0.7399	0.6544	0.7399	0.8602
No log	8.75	420	0.7251	0.6630	0.7251	0.8515
No log	8.7917	422	0.7150	0.6531	0.7150	0.8456
No log	8.8333	424	0.7190	0.6594	0.7190	0.8479
No log	8.875	426	0.7314	0.6578	0.7314	0.8552
No log	8.9167	428	0.7466	0.6676	0.7466	0.8641
No log	8.9583	430	0.7675	0.6607	0.7675	0.8760
No log	9.0	432	0.7891	0.6652	0.7891	0.8883
No log	9.0417	434	0.8076	0.6722	0.8076	0.8986
No log	9.0833	436	0.8126	0.6740	0.8126	0.9015
No log	9.125	438	0.7995	0.6662	0.7995	0.8942
No log	9.1667	440	0.7883	0.6669	0.7883	0.8878
No log	9.2083	442	0.7759	0.6676	0.7759	0.8809
No log	9.25	444	0.7562	0.6614	0.7562	0.8696
No log	9.2917	446	0.7366	0.6630	0.7366	0.8582
No log	9.3333	448	0.7285	0.6594	0.7285	0.8535
No log	9.375	450	0.7257	0.6594	0.7257	0.8519
No log	9.4167	452	0.7273	0.6630	0.7273	0.8528
No log	9.4583	454	0.7305	0.6630	0.7305	0.8547
No log	9.5	456	0.7285	0.6630	0.7285	0.8535
No log	9.5417	458	0.7300	0.6630	0.7300	0.8544
No log	9.5833	460	0.7357	0.6560	0.7357	0.8577
No log	9.625	462	0.7374	0.6560	0.7374	0.8587
No log	9.6667	464	0.7346	0.6560	0.7346	0.8571
No log	9.7083	466	0.7306	0.6560	0.7306	0.8547
No log	9.75	468	0.7299	0.6560	0.7299	0.8543
No log	9.7917	470	0.7310	0.6560	0.7310	0.8550
No log	9.8333	472	0.7331	0.6560	0.7331	0.8562
No log	9.875	474	0.7341	0.6560	0.7341	0.8568
No log	9.9167	476	0.7345	0.6560	0.7345	0.8570
No log	9.9583	478	0.7346	0.6560	0.7346	0.8571
No log	10.0	480	0.7348	0.6560	0.7348	0.8572

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024