ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k12_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k12_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k12_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

40% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 639566e9

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k12_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7429
Qwk: 0.1675
Mse: 0.7429
Rmse: 0.8619

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0417	2	3.5785	0.0100	3.5785	1.8917
No log	0.0833	4	1.6212	0.0168	1.6212	1.2733
No log	0.125	6	0.6580	0.0769	0.6580	0.8111
No log	0.1667	8	0.5727	0.1111	0.5727	0.7568
No log	0.2083	10	0.6506	0.3455	0.6506	0.8066
No log	0.25	12	1.0567	0.0345	1.0567	1.0279
No log	0.2917	14	0.8285	0.0569	0.8285	0.9102
No log	0.3333	16	0.6461	0.2222	0.6461	0.8038
No log	0.375	18	0.5938	0.0	0.5938	0.7706
No log	0.4167	20	0.5850	0.0476	0.5850	0.7649
No log	0.4583	22	0.6699	0.2090	0.6699	0.8184
No log	0.5	24	0.5861	-0.0233	0.5861	0.7655
No log	0.5417	26	0.5737	-0.0159	0.5737	0.7575
No log	0.5833	28	0.6109	0.0725	0.6109	0.7816
No log	0.625	30	0.8701	0.1605	0.8701	0.9328
No log	0.6667	32	1.1479	0.0388	1.1479	1.0714
No log	0.7083	34	0.8812	0.1861	0.8812	0.9387
No log	0.75	36	0.6032	-0.0159	0.6032	0.7766
No log	0.7917	38	0.6030	0.0	0.6030	0.7765
No log	0.8333	40	0.6179	0.0	0.6179	0.7861
No log	0.875	42	0.6407	0.0	0.6407	0.8004
No log	0.9167	44	0.6893	-0.1242	0.6893	0.8303
No log	0.9583	46	0.9267	0.0431	0.9267	0.9626
No log	1.0	48	1.0854	0.0	1.0854	1.0418
No log	1.0417	50	0.9185	0.0	0.9185	0.9584
No log	1.0833	52	0.8377	0.0345	0.8377	0.9153
No log	1.125	54	0.8315	0.0388	0.8315	0.9118
No log	1.1667	56	0.8849	0.0038	0.8849	0.9407
No log	1.2083	58	0.8516	0.0431	0.8516	0.9228
No log	1.25	60	0.7202	0.0189	0.7202	0.8486
No log	1.2917	62	0.6574	0.0476	0.6574	0.8108
No log	1.3333	64	0.6059	0.0	0.6059	0.7784
No log	1.375	66	0.6091	0.0	0.6091	0.7804
No log	1.4167	68	0.6014	0.0	0.6014	0.7755
No log	1.4583	70	0.5985	0.0	0.5985	0.7736
No log	1.5	72	0.6241	0.0569	0.6241	0.7900
No log	1.5417	74	0.6882	0.0256	0.6882	0.8296
No log	1.5833	76	0.7632	0.0685	0.7632	0.8736
No log	1.625	78	0.6556	0.1206	0.6556	0.8097
No log	1.6667	80	0.6183	0.0388	0.6183	0.7863
No log	1.7083	82	0.5977	0.0388	0.5977	0.7731
No log	1.75	84	0.5873	-0.0159	0.5873	0.7664
No log	1.7917	86	0.6107	0.0388	0.6107	0.7815
No log	1.8333	88	0.8396	0.1169	0.8396	0.9163
No log	1.875	90	1.2961	0.0	1.2961	1.1385
No log	1.9167	92	1.1785	0.0	1.1785	1.0856
No log	1.9583	94	0.8113	0.1111	0.8113	0.9007
No log	2.0	96	0.6184	0.0222	0.6184	0.7864
No log	2.0417	98	0.6335	0.0071	0.6335	0.7959
No log	2.0833	100	0.7284	-0.0575	0.7284	0.8534
No log	2.125	102	0.7094	-0.0058	0.7094	0.8423
No log	2.1667	104	0.6759	0.1020	0.6759	0.8221
No log	2.2083	106	0.6256	0.0222	0.6256	0.7909
No log	2.25	108	0.5886	0.0	0.5886	0.7672
No log	2.2917	110	0.5930	0.0	0.5930	0.7700
No log	2.3333	112	0.6728	0.0815	0.6728	0.8202
No log	2.375	114	0.6800	0.1895	0.6800	0.8246
No log	2.4167	116	0.6960	0.1828	0.6960	0.8343
No log	2.4583	118	0.6504	0.3224	0.6504	0.8065
No log	2.5	120	0.6924	0.2390	0.6924	0.8321
No log	2.5417	122	0.7250	0.2300	0.7250	0.8515
No log	2.5833	124	1.2376	0.1484	1.2376	1.1125
No log	2.625	126	1.1443	0.1458	1.1443	1.0697
No log	2.6667	128	0.6649	0.2308	0.6649	0.8154
No log	2.7083	130	0.6148	0.3267	0.6148	0.7841
No log	2.75	132	0.7519	0.2414	0.7519	0.8671
No log	2.7917	134	0.9513	0.2000	0.9513	0.9753
No log	2.8333	136	0.8508	0.3091	0.8508	0.9224
No log	2.875	138	0.6127	0.3208	0.6127	0.7827
No log	2.9167	140	0.6103	0.3953	0.6103	0.7812
No log	2.9583	142	0.8312	0.2961	0.8312	0.9117
No log	3.0	144	0.9111	0.1628	0.9111	0.9545
No log	3.0417	146	1.0003	0.0556	1.0003	1.0002
No log	3.0833	148	0.7756	0.2759	0.7756	0.8807
No log	3.125	150	0.6498	0.2965	0.6498	0.8061
No log	3.1667	152	0.6293	0.3297	0.6293	0.7933
No log	3.2083	154	1.1557	0.1125	1.1557	1.0750
No log	3.25	156	1.6793	0.0377	1.6793	1.2959
No log	3.2917	158	1.6447	0.0377	1.6447	1.2825
No log	3.3333	160	1.2190	0.0984	1.2190	1.1041
No log	3.375	162	0.5396	0.4348	0.5396	0.7346
No log	3.4167	164	0.5628	0.2558	0.5628	0.7502
No log	3.4583	166	0.5333	0.3966	0.5333	0.7302
No log	3.5	168	0.7558	0.3247	0.7558	0.8693
No log	3.5417	170	0.8665	0.1935	0.8665	0.9309
No log	3.5833	172	1.2883	0.0730	1.2883	1.1350
No log	3.625	174	1.3734	0.0328	1.3734	1.1719
No log	3.6667	176	0.9913	0.1943	0.9913	0.9956
No log	3.7083	178	0.6543	0.4019	0.6543	0.8089
No log	3.75	180	0.6655	0.4019	0.6655	0.8158
No log	3.7917	182	0.9609	0.2456	0.9609	0.9803
No log	3.8333	184	1.3026	0.1226	1.3026	1.1413
No log	3.875	186	1.5497	0.0567	1.5497	1.2449
No log	3.9167	188	1.3642	0.1000	1.3642	1.1680
No log	3.9583	190	0.8318	0.1938	0.8318	0.9121
No log	4.0	192	0.6378	0.3498	0.6378	0.7986
No log	4.0417	194	0.6514	0.36	0.6514	0.8071
No log	4.0833	196	0.8987	0.1719	0.8987	0.9480
No log	4.125	198	0.9305	0.1719	0.9305	0.9646
No log	4.1667	200	0.7150	0.2676	0.7150	0.8456
No log	4.2083	202	0.5886	0.4583	0.5886	0.7672
No log	4.25	204	0.5885	0.2941	0.5885	0.7672
No log	4.2917	206	0.5990	0.4583	0.5990	0.7739
No log	4.3333	208	0.8167	0.1587	0.8167	0.9037
No log	4.375	210	1.0180	0.1439	1.0180	1.0089
No log	4.4167	212	1.0529	0.1439	1.0529	1.0261
No log	4.4583	214	0.7675	0.2423	0.7675	0.8761
No log	4.5	216	0.7696	0.2423	0.7696	0.8773
No log	4.5417	218	0.8270	0.1746	0.8270	0.9094
No log	4.5833	220	0.6749	0.3641	0.6749	0.8215
No log	4.625	222	0.6312	0.2663	0.6312	0.7945
No log	4.6667	224	0.6556	0.2195	0.6556	0.8097
No log	4.7083	226	0.5976	0.3778	0.5976	0.7730
No log	4.75	228	0.6937	0.2893	0.6937	0.8329
No log	4.7917	230	0.8039	0.1289	0.8039	0.8966
No log	4.8333	232	0.8600	0.1698	0.8600	0.9273
No log	4.875	234	0.7988	0.1203	0.7988	0.8938
No log	4.9167	236	0.7454	0.3067	0.7454	0.8634
No log	4.9583	238	0.7363	0.3363	0.7363	0.8581
No log	5.0	240	0.9656	0.1524	0.9656	0.9827
No log	5.0417	242	1.3550	0.1155	1.3550	1.1641
No log	5.0833	244	1.3901	0.1467	1.3901	1.1790
No log	5.125	246	1.1222	0.1111	1.1222	1.0593
No log	5.1667	248	0.8740	0.1212	0.8740	0.9349
No log	5.2083	250	0.6330	0.4639	0.6330	0.7956
No log	5.25	252	0.5974	0.4098	0.5974	0.7729
No log	5.2917	254	0.5965	0.4091	0.5965	0.7723
No log	5.3333	256	0.6558	0.2577	0.6558	0.8098
No log	5.375	258	0.7440	0.1931	0.7440	0.8625
No log	5.4167	260	0.6613	0.3089	0.6613	0.8132
No log	5.4583	262	0.5913	0.2575	0.5913	0.7689
No log	5.5	264	0.5903	0.3563	0.5903	0.7683
No log	5.5417	266	0.6475	0.2994	0.6475	0.8047
No log	5.5833	268	0.7861	0.1453	0.7861	0.8866
No log	5.625	270	0.9312	0.1655	0.9312	0.9650
No log	5.6667	272	0.8145	0.1186	0.8145	0.9025
No log	5.7083	274	0.6289	0.4409	0.6289	0.7930
No log	5.75	276	0.6192	0.3563	0.6192	0.7869
No log	5.7917	278	0.6172	0.3520	0.6172	0.7856
No log	5.8333	280	0.6360	0.3548	0.6360	0.7975
No log	5.875	282	0.8515	0.1597	0.8515	0.9228
No log	5.9167	284	0.8781	0.1934	0.8781	0.9371
No log	5.9583	286	0.6893	0.3103	0.6893	0.8303
No log	6.0	288	0.6416	0.3439	0.6416	0.8010
No log	6.0417	290	0.6832	0.3131	0.6832	0.8266
No log	6.0833	292	0.7404	0.2381	0.7404	0.8605
No log	6.125	294	0.7412	0.2381	0.7412	0.8609
No log	6.1667	296	0.6934	0.3103	0.6934	0.8327
No log	6.2083	298	0.6948	0.3103	0.6948	0.8335
No log	6.25	300	0.6998	0.3103	0.6998	0.8365
No log	6.2917	302	0.8295	0.1441	0.8295	0.9108
No log	6.3333	304	0.9735	0.1318	0.9735	0.9867
No log	6.375	306	1.0708	0.1062	1.0708	1.0348
No log	6.4167	308	1.1832	0.1399	1.1832	1.0877
No log	6.4583	310	1.0273	0.0977	1.0273	1.0135
No log	6.5	312	0.7789	0.2661	0.7789	0.8826
No log	6.5417	314	0.7155	0.3367	0.7155	0.8459
No log	6.5833	316	0.7224	0.3035	0.7224	0.8499
No log	6.625	318	0.8238	0.2511	0.8238	0.9076
No log	6.6667	320	0.8768	0.1169	0.8768	0.9364
No log	6.7083	322	0.7889	0.2453	0.7889	0.8882
No log	6.75	324	0.7545	0.2372	0.7545	0.8686
No log	6.7917	326	0.7589	0.2372	0.7589	0.8712
No log	6.8333	328	0.7563	0.2372	0.7563	0.8696
No log	6.875	330	0.8766	0.1930	0.8766	0.9363
No log	6.9167	332	1.0362	0.1062	1.0362	1.0180
No log	6.9583	334	0.9793	0.0988	0.9793	0.9896
No log	7.0	336	0.8438	0.1858	0.8438	0.9186
No log	7.0417	338	0.7736	0.2661	0.7736	0.8795
No log	7.0833	340	0.7884	0.2661	0.7884	0.8879
No log	7.125	342	0.7773	0.2579	0.7773	0.8816
No log	7.1667	344	0.8114	0.2646	0.8114	0.9008
No log	7.2083	346	0.9336	0.1203	0.9336	0.9662
No log	7.25	348	0.9708	0.0598	0.9708	0.9853
No log	7.2917	350	0.9097	0.1130	0.9097	0.9538
No log	7.3333	352	0.8638	0.1405	0.8638	0.9294
No log	7.375	354	0.8638	0.1130	0.8638	0.9294
No log	7.4167	356	0.8771	0.1588	0.8771	0.9365
No log	7.4583	358	0.8429	0.1928	0.8429	0.9181
No log	7.5	360	0.7368	0.1675	0.7368	0.8584
No log	7.5417	362	0.6906	0.2707	0.6906	0.8310
No log	7.5833	364	0.7048	0.2090	0.7048	0.8395
No log	7.625	366	0.7020	0.2093	0.7020	0.8379
No log	7.6667	368	0.6923	0.2093	0.6923	0.8320
No log	7.7083	370	0.7026	0.2093	0.7026	0.8382
No log	7.75	372	0.7238	0.2088	0.7238	0.8508
No log	7.7917	374	0.7165	0.2088	0.7165	0.8464
No log	7.8333	376	0.7489	0.1675	0.7489	0.8654
No log	7.875	378	0.7704	0.2079	0.7704	0.8777
No log	7.9167	380	0.7940	0.2077	0.7940	0.8911
No log	7.9583	382	0.7601	0.2000	0.7601	0.8719
No log	8.0	384	0.7480	0.1919	0.7480	0.8648
No log	8.0417	386	0.7824	0.2390	0.7824	0.8845
No log	8.0833	388	0.7879	0.2390	0.7879	0.8876
No log	8.125	390	0.7902	0.2390	0.7902	0.8889
No log	8.1667	392	0.8387	0.2074	0.8387	0.9158
No log	8.2083	394	0.8657	0.2414	0.8657	0.9304
No log	8.25	396	0.8309	0.2074	0.8309	0.9116
No log	8.2917	398	0.8201	0.2074	0.8201	0.9056
No log	8.3333	400	0.8185	0.2074	0.8185	0.9047
No log	8.375	402	0.8535	0.1855	0.8535	0.9238
No log	8.4167	404	0.8708	0.1861	0.8708	0.9332
No log	8.4583	406	0.8356	0.2593	0.8356	0.9141
No log	8.5	408	0.7707	0.2233	0.7707	0.8779
No log	8.5417	410	0.7268	0.2410	0.7268	0.8525
No log	8.5833	412	0.6999	0.2340	0.6999	0.8366
No log	8.625	414	0.7086	0.2421	0.7086	0.8418
No log	8.6667	416	0.7170	0.2421	0.7170	0.8467
No log	8.7083	418	0.7378	0.2000	0.7378	0.8589
No log	8.75	420	0.7830	0.2075	0.7830	0.8849
No log	8.7917	422	0.8096	0.2593	0.8096	0.8998
No log	8.8333	424	0.8029	0.2593	0.8029	0.8961
No log	8.875	426	0.8020	0.2593	0.8020	0.8955
No log	8.9167	428	0.7814	0.2536	0.7814	0.8840
No log	8.9583	430	0.7470	0.2871	0.7470	0.8643
No log	9.0	432	0.7215	0.2000	0.7215	0.8494
No log	9.0417	434	0.7253	0.2000	0.7253	0.8516
No log	9.0833	436	0.7335	0.2390	0.7335	0.8564
No log	9.125	438	0.7537	0.2390	0.7537	0.8682
No log	9.1667	440	0.7747	0.2563	0.7747	0.8802
No log	9.2083	442	0.7917	0.2941	0.7917	0.8898
No log	9.25	444	0.7751	0.2079	0.7751	0.8804
No log	9.2917	446	0.7506	0.2390	0.7506	0.8664
No log	9.3333	448	0.7355	0.2000	0.7355	0.8576
No log	9.375	450	0.7145	0.2421	0.7145	0.8453
No log	9.4167	452	0.7057	0.2746	0.7057	0.8400
No log	9.4583	454	0.6956	0.2563	0.6956	0.8340
No log	9.5	456	0.6909	0.28	0.6909	0.8312
No log	9.5417	458	0.6899	0.28	0.6899	0.8306
No log	9.5833	460	0.6969	0.2653	0.6969	0.8348
No log	9.625	462	0.7084	0.2421	0.7084	0.8416
No log	9.6667	464	0.7230	0.2000	0.7230	0.8503
No log	9.7083	466	0.7360	0.2000	0.7360	0.8579
No log	9.75	468	0.7397	0.2000	0.7397	0.8600
No log	9.7917	470	0.7396	0.2000	0.7396	0.8600
No log	9.8333	472	0.7377	0.2000	0.7377	0.8589
No log	9.875	474	0.7386	0.2000	0.7386	0.8594
No log	9.9167	476	0.7413	0.1675	0.7413	0.8610
No log	9.9583	478	0.7422	0.1675	0.7422	0.8615
No log	10.0	480	0.7429	0.1675	0.7429	0.8619

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024