ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k12_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k12_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k12_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

40% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 860a233e

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k12_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7405
Qwk: 0.2487
Mse: 0.7405
Rmse: 0.8605

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0417	2	3.5785	0.0100	3.5785	1.8917
No log	0.0833	4	1.6212	0.0168	1.6212	1.2733
No log	0.125	6	0.6580	0.0769	0.6580	0.8111
No log	0.1667	8	0.5727	0.1111	0.5727	0.7568
No log	0.2083	10	0.6506	0.3455	0.6506	0.8066
No log	0.25	12	1.0567	0.0345	1.0567	1.0279
No log	0.2917	14	0.8285	0.0569	0.8285	0.9102
No log	0.3333	16	0.6461	0.2222	0.6461	0.8038
No log	0.375	18	0.5938	0.0	0.5938	0.7706
No log	0.4167	20	0.5850	0.0476	0.5850	0.7649
No log	0.4583	22	0.6699	0.2090	0.6699	0.8184
No log	0.5	24	0.5861	-0.0233	0.5861	0.7655
No log	0.5417	26	0.5737	-0.0159	0.5737	0.7575
No log	0.5833	28	0.6109	0.0725	0.6109	0.7816
No log	0.625	30	0.8701	0.1605	0.8701	0.9328
No log	0.6667	32	1.1479	0.0388	1.1479	1.0714
No log	0.7083	34	0.8812	0.1861	0.8812	0.9387
No log	0.75	36	0.6032	-0.0159	0.6032	0.7766
No log	0.7917	38	0.6030	0.0	0.6030	0.7765
No log	0.8333	40	0.6179	0.0	0.6179	0.7861
No log	0.875	42	0.6407	0.0	0.6407	0.8004
No log	0.9167	44	0.6894	-0.1242	0.6894	0.8303
No log	0.9583	46	0.9268	0.0431	0.9268	0.9627
No log	1.0	48	1.0855	0.0	1.0855	1.0419
No log	1.0417	50	0.9185	0.0	0.9185	0.9584
No log	1.0833	52	0.8377	0.0345	0.8377	0.9153
No log	1.125	54	0.8314	0.0388	0.8314	0.9118
No log	1.1667	56	0.8849	0.0038	0.8849	0.9407
No log	1.2083	58	0.8516	0.0431	0.8516	0.9228
No log	1.25	60	0.7202	0.0189	0.7202	0.8487
No log	1.2917	62	0.6574	0.0476	0.6574	0.8108
No log	1.3333	64	0.6059	0.0	0.6059	0.7784
No log	1.375	66	0.6091	0.0	0.6091	0.7804
No log	1.4167	68	0.6014	0.0	0.6014	0.7755
No log	1.4583	70	0.5986	0.0	0.5986	0.7737
No log	1.5	72	0.6241	0.0569	0.6241	0.7900
No log	1.5417	74	0.6882	0.0256	0.6882	0.8296
No log	1.5833	76	0.7631	0.0685	0.7631	0.8736
No log	1.625	78	0.6555	0.1206	0.6555	0.8097
No log	1.6667	80	0.6183	0.0388	0.6183	0.7863
No log	1.7083	82	0.5977	0.0388	0.5977	0.7731
No log	1.75	84	0.5874	-0.0159	0.5874	0.7664
No log	1.7917	86	0.6108	0.0388	0.6108	0.7815
No log	1.8333	88	0.8397	0.1169	0.8397	0.9164
No log	1.875	90	1.2963	0.0	1.2963	1.1385
No log	1.9167	92	1.1785	0.0	1.1785	1.0856
No log	1.9583	94	0.8113	0.1111	0.8113	0.9007
No log	2.0	96	0.6184	0.0222	0.6184	0.7864
No log	2.0417	98	0.6336	0.0071	0.6336	0.7960
No log	2.0833	100	0.7285	-0.0575	0.7285	0.8535
No log	2.125	102	0.7095	-0.0058	0.7095	0.8423
No log	2.1667	104	0.6757	0.1020	0.6757	0.8220
No log	2.2083	106	0.6254	0.0222	0.6254	0.7908
No log	2.25	108	0.5885	0.0	0.5885	0.7671
No log	2.2917	110	0.5930	0.0	0.5930	0.7701
No log	2.3333	112	0.6732	0.0815	0.6732	0.8205
No log	2.375	114	0.6804	0.1895	0.6804	0.8249
No log	2.4167	116	0.6965	0.1828	0.6965	0.8345
No log	2.4583	118	0.6503	0.3224	0.6503	0.8064
No log	2.5	120	0.6923	0.2390	0.6923	0.8321
No log	2.5417	122	0.7249	0.2300	0.7249	0.8514
No log	2.5833	124	1.2372	0.1484	1.2372	1.1123
No log	2.625	126	1.1434	0.1458	1.1434	1.0693
No log	2.6667	128	0.6642	0.2308	0.6642	0.8150
No log	2.7083	130	0.6143	0.3267	0.6143	0.7837
No log	2.75	132	0.7508	0.2423	0.7508	0.8665
No log	2.7917	134	0.9510	0.2000	0.9510	0.9752
No log	2.8333	136	0.8510	0.3091	0.8510	0.9225
No log	2.875	138	0.6127	0.3208	0.6127	0.7827
No log	2.9167	140	0.6103	0.3953	0.6103	0.7812
No log	2.9583	142	0.8309	0.2961	0.8309	0.9115
No log	3.0	144	0.9098	0.1628	0.9098	0.9539
No log	3.0417	146	0.9985	0.0853	0.9985	0.9993
No log	3.0833	148	0.7747	0.2759	0.7747	0.8802
No log	3.125	150	0.6495	0.2965	0.6495	0.8059
No log	3.1667	152	0.6290	0.3297	0.6290	0.7931
No log	3.2083	154	1.1584	0.1125	1.1584	1.0763
No log	3.25	156	1.6810	0.0377	1.6810	1.2966
No log	3.2917	158	1.6466	0.0377	1.6466	1.2832
No log	3.3333	160	1.2205	0.0984	1.2205	1.1048
No log	3.375	162	0.5392	0.4348	0.5392	0.7343
No log	3.4167	164	0.5636	0.2558	0.5636	0.7507
No log	3.4583	166	0.5325	0.3966	0.5325	0.7297
No log	3.5	168	0.7531	0.2920	0.7531	0.8678
No log	3.5417	170	0.8639	0.1935	0.8639	0.9295
No log	3.5833	172	1.2872	0.0730	1.2872	1.1346
No log	3.625	174	1.3726	0.0328	1.3726	1.1716
No log	3.6667	176	0.9910	0.1943	0.9910	0.9955
No log	3.7083	178	0.6521	0.4019	0.6521	0.8075
No log	3.75	180	0.6620	0.4019	0.6620	0.8136
No log	3.7917	182	0.9548	0.2456	0.9548	0.9771
No log	3.8333	184	1.2968	0.1213	1.2968	1.1388
No log	3.875	186	1.5456	0.0567	1.5456	1.2432
No log	3.9167	188	1.3617	0.1000	1.3617	1.1669
No log	3.9583	190	0.8316	0.1938	0.8316	0.9119
No log	4.0	192	0.6374	0.3498	0.6374	0.7984
No log	4.0417	194	0.6496	0.36	0.6496	0.8060
No log	4.0833	196	0.8948	0.1709	0.8948	0.9459
No log	4.125	198	0.9269	0.1719	0.9269	0.9628
No log	4.1667	200	0.7156	0.2676	0.7156	0.8459
No log	4.2083	202	0.5890	0.4583	0.5890	0.7675
No log	4.25	204	0.5885	0.2941	0.5885	0.7671
No log	4.2917	206	0.5992	0.4583	0.5992	0.7741
No log	4.3333	208	0.8168	0.1587	0.8168	0.9038
No log	4.375	210	1.0182	0.1439	1.0182	1.0091
No log	4.4167	212	1.0505	0.1439	1.0505	1.0250
No log	4.4583	214	0.7647	0.2423	0.7647	0.8745
No log	4.5	216	0.7676	0.2423	0.7676	0.8762
No log	4.5417	218	0.8252	0.2065	0.8252	0.9084
No log	4.5833	220	0.6739	0.3641	0.6739	0.8209
No log	4.625	222	0.6308	0.2663	0.6308	0.7942
No log	4.6667	224	0.6550	0.2195	0.6550	0.8093
No log	4.7083	226	0.5970	0.3778	0.5970	0.7726
No log	4.75	228	0.6929	0.2893	0.6929	0.8324
No log	4.7917	230	0.8022	0.1289	0.8022	0.8957
No log	4.8333	232	0.8586	0.1698	0.8586	0.9266
No log	4.875	234	0.7980	0.1203	0.7980	0.8933
No log	4.9167	236	0.7451	0.3043	0.7451	0.8632
No log	4.9583	238	0.7366	0.3091	0.7366	0.8582
No log	5.0	240	0.9668	0.1524	0.9668	0.9832
No log	5.0417	242	1.3558	0.1155	1.3558	1.1644
No log	5.0833	244	1.3901	0.1467	1.3901	1.1790
No log	5.125	246	1.1216	0.1111	1.1216	1.0591
No log	5.1667	248	0.8734	0.1212	0.8734	0.9345
No log	5.2083	250	0.6333	0.4518	0.6333	0.7958
No log	5.25	252	0.5981	0.4098	0.5981	0.7734
No log	5.2917	254	0.5978	0.4091	0.5978	0.7732
No log	5.3333	256	0.6571	0.2577	0.6571	0.8106
No log	5.375	258	0.7424	0.1931	0.7424	0.8616
No log	5.4167	260	0.6580	0.3118	0.6580	0.8112
No log	5.4583	262	0.5911	0.2575	0.5911	0.7688
No log	5.5	264	0.5912	0.3966	0.5912	0.7689
No log	5.5417	266	0.6540	0.2994	0.6540	0.8087
No log	5.5833	268	0.7771	0.1730	0.7771	0.8815
No log	5.625	270	0.9124	0.1642	0.9124	0.9552
No log	5.6667	272	0.7961	0.1186	0.7961	0.8922
No log	5.7083	274	0.6263	0.4409	0.6263	0.7914
No log	5.75	276	0.6143	0.3520	0.6143	0.7838
No log	5.7917	278	0.6093	0.3913	0.6093	0.7806
No log	5.8333	280	0.6643	0.3297	0.6643	0.8150
No log	5.875	282	0.9091	0.1621	0.9091	0.9535
No log	5.9167	284	0.9098	0.2253	0.9098	0.9539
No log	5.9583	286	0.6944	0.28	0.6944	0.8333
No log	6.0	288	0.6387	0.3439	0.6387	0.7992
No log	6.0417	290	0.6752	0.3131	0.6752	0.8217
No log	6.0833	292	0.7385	0.2381	0.7385	0.8594
No log	6.125	294	0.7497	0.2381	0.7497	0.8659
No log	6.1667	296	0.6998	0.2692	0.6998	0.8366
No log	6.2083	298	0.6887	0.3103	0.6887	0.8299
No log	6.25	300	0.6922	0.3035	0.6922	0.8320
No log	6.2917	302	0.8152	0.1071	0.8152	0.9029
No log	6.3333	304	0.9786	0.1318	0.9786	0.9892
No log	6.375	306	1.1042	0.1367	1.1042	1.0508
No log	6.4167	308	1.2382	0.1399	1.2382	1.1127
No log	6.4583	310	1.0936	0.1062	1.0936	1.0457
No log	6.5	312	0.8254	0.2442	0.8254	0.9085
No log	6.5417	314	0.7450	0.2676	0.7450	0.8631
No log	6.5833	316	0.7539	0.2372	0.7539	0.8683
No log	6.625	318	0.8233	0.2150	0.8233	0.9074
No log	6.6667	320	0.8303	0.2511	0.8303	0.9112
No log	6.7083	322	0.7481	0.2372	0.7481	0.8649
No log	6.75	324	0.7316	0.3103	0.7316	0.8554
No log	6.7917	326	0.7806	0.2372	0.7806	0.8835
No log	6.8333	328	0.8357	0.2140	0.8357	0.9142
No log	6.875	330	1.0272	0.0722	1.0272	1.0135
No log	6.9167	332	1.1620	0.1095	1.1620	1.0779
No log	6.9583	334	1.0533	0.0746	1.0533	1.0263
No log	7.0	336	0.8687	0.1858	0.8687	0.9321
No log	7.0417	338	0.7931	0.2348	0.7931	0.8905
No log	7.0833	340	0.8385	0.2681	0.8385	0.9157
No log	7.125	342	0.8261	0.2356	0.8261	0.9089
No log	7.1667	344	0.8454	0.2696	0.8454	0.9195
No log	7.2083	346	0.9252	0.0916	0.9252	0.9619
No log	7.25	348	0.9319	0.0916	0.9319	0.9654
No log	7.2917	350	0.8652	0.2066	0.8652	0.9301
No log	7.3333	352	0.8678	0.1799	0.8678	0.9316
No log	7.375	354	0.9149	0.1261	0.9149	0.9565
No log	7.4167	356	0.9658	0.0698	0.9658	0.9828
No log	7.4583	358	0.9303	0.0968	0.9303	0.9645
No log	7.5	360	0.7870	0.2692	0.7870	0.8871
No log	7.5417	362	0.7072	0.2000	0.7072	0.8409
No log	7.5833	364	0.7124	0.1658	0.7124	0.8440
No log	7.625	366	0.7021	0.2090	0.7021	0.8379
No log	7.6667	368	0.6932	0.2093	0.6932	0.8326
No log	7.7083	370	0.7141	0.2088	0.7141	0.8450
No log	7.75	372	0.7481	0.2563	0.7481	0.8649
No log	7.7917	374	0.7455	0.2563	0.7455	0.8634
No log	7.8333	376	0.7660	0.2549	0.7660	0.8752
No log	7.875	378	0.7683	0.2549	0.7683	0.8765
No log	7.9167	380	0.7805	0.2077	0.7805	0.8835
No log	7.9583	382	0.7490	0.2000	0.7490	0.8655
No log	8.0	384	0.7483	0.1921	0.7483	0.8651
No log	8.0417	386	0.7971	0.2372	0.7971	0.8928
No log	8.0833	388	0.8101	0.2075	0.8101	0.9001
No log	8.125	390	0.8032	0.2372	0.8032	0.8962
No log	8.1667	392	0.8361	0.2423	0.8361	0.9144
No log	8.2083	394	0.8491	0.2423	0.8491	0.9214
No log	8.25	396	0.8154	0.2074	0.8154	0.9030
No log	8.2917	398	0.8131	0.2074	0.8131	0.9017
No log	8.3333	400	0.8255	0.2857	0.8255	0.9086
No log	8.375	402	0.8752	0.1858	0.8752	0.9355
No log	8.4167	404	0.8929	0.1861	0.8929	0.9450
No log	8.4583	406	0.8482	0.1858	0.8482	0.9210
No log	8.5	408	0.7778	0.2233	0.7778	0.8820
No log	8.5417	410	0.7336	0.2000	0.7336	0.8565
No log	8.5833	412	0.7057	0.2670	0.7057	0.8400
No log	8.625	414	0.7141	0.2670	0.7141	0.8451
No log	8.6667	416	0.7258	0.2000	0.7258	0.8520
No log	8.7083	418	0.7493	0.2381	0.7493	0.8656
No log	8.75	420	0.7971	0.2897	0.7971	0.8928
No log	8.7917	422	0.8226	0.2593	0.8226	0.9069
No log	8.8333	424	0.8149	0.2593	0.8149	0.9027
No log	8.875	426	0.8168	0.2593	0.8168	0.9038
No log	8.9167	428	0.7964	0.2897	0.7964	0.8924
No log	8.9583	430	0.7582	0.2871	0.7582	0.8707
No log	9.0	432	0.7267	0.24	0.7267	0.8525
No log	9.0417	434	0.7270	0.24	0.7270	0.8526
No log	9.0833	436	0.7339	0.2390	0.7339	0.8567
No log	9.125	438	0.7557	0.2390	0.7557	0.8693
No log	9.1667	440	0.7770	0.2850	0.7770	0.8815
No log	9.2083	442	0.7951	0.2897	0.7951	0.8917
No log	9.25	444	0.7795	0.2919	0.7795	0.8829
No log	9.2917	446	0.7538	0.2390	0.7538	0.8682
No log	9.3333	448	0.7373	0.2000	0.7373	0.8587
No log	9.375	450	0.7152	0.2000	0.7152	0.8457
No log	9.4167	452	0.7053	0.2746	0.7053	0.8398
No log	9.4583	454	0.6944	0.2746	0.6944	0.8333
No log	9.5	456	0.6891	0.2487	0.6891	0.8301
No log	9.5417	458	0.6878	0.2487	0.6878	0.8293
No log	9.5833	460	0.6944	0.2746	0.6944	0.8333
No log	9.625	462	0.7056	0.2746	0.7056	0.8400
No log	9.6667	464	0.7196	0.2000	0.7196	0.8483
No log	9.7083	466	0.7321	0.2000	0.7321	0.8556
No log	9.75	468	0.7357	0.2000	0.7357	0.8577
No log	9.7917	470	0.7362	0.2000	0.7362	0.8580
No log	9.8333	472	0.7349	0.2000	0.7349	0.8573
No log	9.875	474	0.7359	0.2000	0.7359	0.8579
No log	9.9167	476	0.7387	0.2487	0.7387	0.8595
No log	9.9583	478	0.7397	0.2487	0.7397	0.8600
No log	10.0	480	0.7405	0.2487	0.7405	0.8605

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024