ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k17_task5_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k17_task5_organization

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k17_task5_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

50% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 8540969e

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k17_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.8034
Qwk: 0.7246
Mse: 0.8034
Rmse: 0.8963

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0385	2	2.3478	0.0485	2.3478	1.5323
No log	0.0769	4	1.4657	0.1930	1.4657	1.2107
No log	0.1154	6	1.3861	0.1851	1.3861	1.1773
No log	0.1538	8	1.7611	0.3084	1.7611	1.3271
No log	0.1923	10	2.0248	0.2039	2.0248	1.4230
No log	0.2308	12	1.5862	0.2493	1.5862	1.2594
No log	0.2692	14	1.4604	0.1209	1.4604	1.2085
No log	0.3077	16	1.4653	0.1040	1.4653	1.2105
No log	0.3462	18	1.6174	0.2435	1.6174	1.2718
No log	0.3846	20	2.0881	0.2249	2.0881	1.4450
No log	0.4231	22	2.2308	0.1964	2.2308	1.4936
No log	0.4615	24	2.0003	0.2328	2.0003	1.4143
No log	0.5	26	1.8717	0.2389	1.8717	1.3681
No log	0.5385	28	1.8235	0.2241	1.8235	1.3504
No log	0.5769	30	1.7405	0.3101	1.7405	1.3193
No log	0.6154	32	1.6524	0.3181	1.6524	1.2855
No log	0.6538	34	1.6201	0.3173	1.6201	1.2728
No log	0.6923	36	1.5903	0.3173	1.5903	1.2611
No log	0.7308	38	1.5839	0.3738	1.5839	1.2585
No log	0.7692	40	1.4949	0.3445	1.4949	1.2227
No log	0.8077	42	1.4052	0.3573	1.4052	1.1854
No log	0.8462	44	1.2829	0.3749	1.2829	1.1327
No log	0.8846	46	1.0915	0.4431	1.0915	1.0447
No log	0.9231	48	1.0561	0.4425	1.0561	1.0277
No log	0.9615	50	1.0552	0.4713	1.0552	1.0272
No log	1.0	52	1.3293	0.4618	1.3293	1.1530
No log	1.0385	54	1.2243	0.4541	1.2243	1.1065
No log	1.0769	56	0.9462	0.4596	0.9462	0.9727
No log	1.1154	58	0.9965	0.4678	0.9965	0.9982
No log	1.1538	60	1.3759	0.4510	1.3759	1.1730
No log	1.1923	62	1.5175	0.3780	1.5175	1.2319
No log	1.2308	64	1.0405	0.5070	1.0405	1.0201
No log	1.2692	66	0.7623	0.6399	0.7623	0.8731
No log	1.3077	68	0.7693	0.5924	0.7693	0.8771
No log	1.3462	70	0.8106	0.5812	0.8106	0.9003
No log	1.3846	72	0.9958	0.5329	0.9958	0.9979
No log	1.4231	74	1.1326	0.5472	1.1326	1.0643
No log	1.4615	76	1.0540	0.5772	1.0540	1.0266
No log	1.5	78	0.9008	0.6044	0.9008	0.9491
No log	1.5385	80	0.8375	0.6130	0.8375	0.9151
No log	1.5769	82	0.9499	0.6391	0.9499	0.9747
No log	1.6154	84	1.1456	0.5737	1.1456	1.0703
No log	1.6538	86	1.4662	0.4862	1.4662	1.2109
No log	1.6923	88	1.3067	0.5240	1.3067	1.1431
No log	1.7308	90	0.8336	0.6365	0.8336	0.9130
No log	1.7692	92	0.6825	0.6952	0.6825	0.8262
No log	1.8077	94	0.6987	0.6596	0.6987	0.8359
No log	1.8462	96	0.6706	0.7102	0.6706	0.8189
No log	1.8846	98	0.9327	0.6369	0.9327	0.9657
No log	1.9231	100	1.6015	0.5206	1.6015	1.2655
No log	1.9615	102	1.8024	0.4687	1.8024	1.3425
No log	2.0	104	1.5199	0.4980	1.5199	1.2329
No log	2.0385	106	1.1380	0.5661	1.1380	1.0668
No log	2.0769	108	0.9398	0.6222	0.9398	0.9694
No log	2.1154	110	0.8642	0.7131	0.8642	0.9296
No log	2.1538	112	0.9189	0.6663	0.9189	0.9586
No log	2.1923	114	0.9631	0.6307	0.9631	0.9814
No log	2.2308	116	1.0529	0.6276	1.0529	1.0261
No log	2.2692	118	1.1492	0.6030	1.1492	1.0720
No log	2.3077	120	1.1044	0.6271	1.1044	1.0509
No log	2.3462	122	1.2565	0.6105	1.2565	1.1209
No log	2.3846	124	1.2941	0.5923	1.2941	1.1376
No log	2.4231	126	1.0658	0.6376	1.0658	1.0324
No log	2.4615	128	0.8854	0.6720	0.8854	0.9410
No log	2.5	130	0.9133	0.6628	0.9133	0.9557
No log	2.5385	132	1.0626	0.6114	1.0626	1.0308
No log	2.5769	134	0.9316	0.6295	0.9316	0.9652
No log	2.6154	136	0.7615	0.7103	0.7615	0.8726
No log	2.6538	138	0.6867	0.7083	0.6867	0.8287
No log	2.6923	140	0.6917	0.7286	0.6917	0.8317
No log	2.7308	142	0.7284	0.7217	0.7284	0.8535
No log	2.7692	144	0.8389	0.6888	0.8389	0.9159
No log	2.8077	146	0.8901	0.6697	0.8901	0.9434
No log	2.8462	148	0.8632	0.6869	0.8632	0.9291
No log	2.8846	150	0.7899	0.7146	0.7899	0.8888
No log	2.9231	152	0.6991	0.7370	0.6991	0.8361
No log	2.9615	154	0.6942	0.7514	0.6942	0.8332
No log	3.0	156	0.7134	0.7469	0.7134	0.8446
No log	3.0385	158	0.7240	0.7302	0.7240	0.8509
No log	3.0769	160	0.6538	0.7530	0.6538	0.8086
No log	3.1154	162	0.6612	0.7396	0.6612	0.8132
No log	3.1538	164	0.6927	0.7592	0.6927	0.8323
No log	3.1923	166	0.7671	0.7164	0.7671	0.8758
No log	3.2308	168	0.8220	0.6984	0.8220	0.9066
No log	3.2692	170	0.8676	0.6647	0.8676	0.9314
No log	3.3077	172	1.0876	0.6251	1.0876	1.0429
No log	3.3462	174	1.1443	0.6305	1.1443	1.0697
No log	3.3846	176	0.9311	0.6720	0.9311	0.9649
No log	3.4231	178	0.6768	0.7810	0.6768	0.8227
No log	3.4615	180	0.5908	0.7282	0.5908	0.7687
No log	3.5	182	0.5884	0.7217	0.5884	0.7671
No log	3.5385	184	0.6164	0.7671	0.6164	0.7851
No log	3.5769	186	0.8198	0.7184	0.8198	0.9054
No log	3.6154	188	0.9880	0.6476	0.9880	0.9940
No log	3.6538	190	1.0983	0.6268	1.0983	1.0480
No log	3.6923	192	1.1270	0.6305	1.1270	1.0616
No log	3.7308	194	1.0455	0.6639	1.0455	1.0225
No log	3.7692	196	0.8940	0.7015	0.8940	0.9455
No log	3.8077	198	0.8145	0.7127	0.8145	0.9025
No log	3.8462	200	0.7348	0.7210	0.7348	0.8572
No log	3.8846	202	0.6805	0.7605	0.6805	0.8250
No log	3.9231	204	0.6798	0.7469	0.6798	0.8245
No log	3.9615	206	0.7394	0.7289	0.7394	0.8599
No log	4.0	208	0.7594	0.7168	0.7594	0.8715
No log	4.0385	210	0.7554	0.7296	0.7554	0.8691
No log	4.0769	212	0.6921	0.7380	0.6921	0.8319
No log	4.1154	214	0.7129	0.7302	0.7129	0.8443
No log	4.1538	216	0.6581	0.7385	0.6581	0.8112
No log	4.1923	218	0.5944	0.7658	0.5944	0.7710
No log	4.2308	220	0.5995	0.7701	0.5995	0.7743
No log	4.2692	222	0.6563	0.7379	0.6563	0.8101
No log	4.3077	224	0.7640	0.7135	0.7640	0.8741
No log	4.3462	226	0.8579	0.6918	0.8579	0.9262
No log	4.3846	228	0.7903	0.7143	0.7903	0.8890
No log	4.4231	230	0.6814	0.7493	0.6814	0.8255
No log	4.4615	232	0.6292	0.7535	0.6292	0.7932
No log	4.5	234	0.6164	0.7419	0.6164	0.7851
No log	4.5385	236	0.6543	0.7513	0.6543	0.8089
No log	4.5769	238	0.6835	0.7461	0.6835	0.8268
No log	4.6154	240	0.6816	0.7517	0.6816	0.8256
No log	4.6538	242	0.6262	0.7566	0.6262	0.7914
No log	4.6923	244	0.6205	0.7491	0.6205	0.7877
No log	4.7308	246	0.6722	0.7510	0.6722	0.8199
No log	4.7692	248	0.7383	0.7239	0.7383	0.8592
No log	4.8077	250	0.7217	0.7259	0.7217	0.8495
No log	4.8462	252	0.7208	0.7302	0.7208	0.8490
No log	4.8846	254	0.7018	0.7324	0.7018	0.8377
No log	4.9231	256	0.6873	0.7554	0.6873	0.8290
No log	4.9615	258	0.7413	0.7296	0.7413	0.8610
No log	5.0	260	0.7821	0.7169	0.7821	0.8844
No log	5.0385	262	0.7425	0.7253	0.7425	0.8617
No log	5.0769	264	0.6745	0.7603	0.6745	0.8213
No log	5.1154	266	0.6235	0.7354	0.6235	0.7896
No log	5.1538	268	0.6232	0.7483	0.6232	0.7895
No log	5.1923	270	0.6684	0.7679	0.6684	0.8176
No log	5.2308	272	0.7488	0.7233	0.7488	0.8653
No log	5.2692	274	0.7363	0.7408	0.7363	0.8581
No log	5.3077	276	0.6916	0.7484	0.6916	0.8316
No log	5.3462	278	0.6956	0.7480	0.6956	0.8340
No log	5.3846	280	0.6556	0.7418	0.6556	0.8097
No log	5.4231	282	0.6209	0.7429	0.6209	0.7880
No log	5.4615	284	0.6114	0.7310	0.6114	0.7819
No log	5.5	286	0.6351	0.7358	0.6351	0.7969
No log	5.5385	288	0.7119	0.7213	0.7119	0.8437
No log	5.5769	290	0.7650	0.6976	0.7650	0.8746
No log	5.6154	292	0.7829	0.6976	0.7829	0.8848
No log	5.6538	294	0.8433	0.6846	0.8433	0.9183
No log	5.6923	296	0.8048	0.6999	0.8048	0.8971
No log	5.7308	298	0.7969	0.7018	0.7969	0.8927
No log	5.7692	300	0.8201	0.6882	0.8201	0.9056
No log	5.8077	302	0.8913	0.6763	0.8913	0.9441
No log	5.8462	304	0.9085	0.6476	0.9085	0.9532
No log	5.8846	306	0.8303	0.6583	0.8303	0.9112
No log	5.9231	308	0.7339	0.7266	0.7339	0.8567
No log	5.9615	310	0.6839	0.7061	0.6839	0.8270
No log	6.0	312	0.6789	0.6994	0.6789	0.8239
No log	6.0385	314	0.6929	0.7061	0.6929	0.8324
No log	6.0769	316	0.7168	0.7144	0.7168	0.8466
No log	6.1154	318	0.7937	0.6806	0.7937	0.8909
No log	6.1538	320	0.8773	0.6473	0.8773	0.9366
No log	6.1923	322	0.8905	0.6473	0.8905	0.9436
No log	6.2308	324	0.9077	0.6469	0.9077	0.9527
No log	6.2692	326	0.9629	0.6439	0.9629	0.9813
No log	6.3077	328	1.0147	0.6368	1.0147	1.0073
No log	6.3462	330	0.9935	0.6469	0.9935	0.9968
No log	6.3846	332	0.9092	0.6469	0.9092	0.9535
No log	6.4231	334	0.8718	0.6585	0.8718	0.9337
No log	6.4615	336	0.8185	0.6892	0.8185	0.9047
No log	6.5	338	0.7712	0.7072	0.7712	0.8782
No log	6.5385	340	0.7528	0.7200	0.7528	0.8676
No log	6.5769	342	0.7635	0.7282	0.7635	0.8738
No log	6.6154	344	0.7759	0.7202	0.7759	0.8808
No log	6.6538	346	0.7624	0.7246	0.7624	0.8732
No log	6.6923	348	0.7432	0.7190	0.7432	0.8621
No log	6.7308	350	0.7791	0.6918	0.7791	0.8826
No log	6.7692	352	0.8172	0.6892	0.8172	0.9040
No log	6.8077	354	0.8258	0.6892	0.8258	0.9088
No log	6.8462	356	0.7975	0.7072	0.7975	0.8930
No log	6.8846	358	0.7711	0.7267	0.7711	0.8781
No log	6.9231	360	0.7535	0.7370	0.7535	0.8680
No log	6.9615	362	0.7432	0.7436	0.7432	0.8621
No log	7.0	364	0.7318	0.7480	0.7318	0.8555
No log	7.0385	366	0.6994	0.7568	0.6994	0.8363
No log	7.0769	368	0.6977	0.7686	0.6977	0.8353
No log	7.1154	370	0.7406	0.7418	0.7406	0.8606
No log	7.1538	372	0.7978	0.7192	0.7978	0.8932
No log	7.1923	374	0.8181	0.7151	0.8181	0.9045
No log	7.2308	376	0.7874	0.7190	0.7874	0.8874
No log	7.2692	378	0.7234	0.7461	0.7234	0.8505
No log	7.3077	380	0.6909	0.7587	0.6909	0.8312
No log	7.3462	382	0.6737	0.7631	0.6737	0.8208
No log	7.3846	384	0.6758	0.7587	0.6758	0.8221
No log	7.4231	386	0.7000	0.7644	0.7000	0.8366
No log	7.4615	388	0.7324	0.7412	0.7324	0.8558
No log	7.5	390	0.7294	0.7414	0.7294	0.8540
No log	7.5385	392	0.7059	0.7483	0.7059	0.8402
No log	7.5769	394	0.6905	0.7411	0.6905	0.8310
No log	7.6154	396	0.6917	0.7404	0.6917	0.8317
No log	7.6538	398	0.6958	0.7296	0.6958	0.8341
No log	7.6923	400	0.7063	0.7296	0.7063	0.8404
No log	7.7308	402	0.7054	0.7209	0.7054	0.8399
No log	7.7692	404	0.7184	0.7250	0.7184	0.8476
No log	7.8077	406	0.7494	0.7048	0.7494	0.8657
No log	7.8462	408	0.7899	0.6862	0.7899	0.8887
No log	7.8846	410	0.8218	0.6911	0.8218	0.9065
No log	7.9231	412	0.8626	0.6645	0.8626	0.9287
No log	7.9615	414	0.8589	0.6739	0.8589	0.9267
No log	8.0	416	0.8354	0.6953	0.8354	0.9140
No log	8.0385	418	0.7898	0.7145	0.7898	0.8887
No log	8.0769	420	0.7421	0.7296	0.7421	0.8614
No log	8.1154	422	0.7414	0.7296	0.7414	0.8611
No log	8.1538	424	0.7732	0.7152	0.7732	0.8793
No log	8.1923	426	0.8249	0.7053	0.8249	0.9082
No log	8.2308	428	0.8952	0.6822	0.8952	0.9462
No log	8.2692	430	0.9507	0.6547	0.9507	0.9750
No log	8.3077	432	0.9505	0.6547	0.9505	0.9749
No log	8.3462	434	0.9092	0.6663	0.9092	0.9535
No log	8.3846	436	0.8580	0.6776	0.8580	0.9263
No log	8.4231	438	0.8000	0.6999	0.8000	0.8944
No log	8.4615	440	0.7462	0.7077	0.7462	0.8638
No log	8.5	442	0.6988	0.7433	0.6988	0.8360
No log	8.5385	444	0.6802	0.7357	0.6802	0.8247
No log	8.5769	446	0.6808	0.7357	0.6808	0.8251
No log	8.6154	448	0.7004	0.7433	0.7004	0.8369
No log	8.6538	450	0.7349	0.7430	0.7349	0.8572
No log	8.6923	452	0.7813	0.7122	0.7813	0.8839
No log	8.7308	454	0.8176	0.6900	0.8176	0.9042
No log	8.7692	456	0.8454	0.6705	0.8454	0.9194
No log	8.8077	458	0.8555	0.6705	0.8555	0.9249
No log	8.8462	460	0.8455	0.6705	0.8455	0.9195
No log	8.8846	462	0.8301	0.6900	0.8301	0.9111
No log	8.9231	464	0.8240	0.6900	0.8240	0.9077
No log	8.9615	466	0.8034	0.6900	0.8034	0.8963
No log	9.0	468	0.7734	0.7246	0.7734	0.8794
No log	9.0385	470	0.7455	0.7370	0.7455	0.8634
No log	9.0769	472	0.7357	0.7414	0.7357	0.8577
No log	9.1154	474	0.7424	0.7370	0.7424	0.8616
No log	9.1538	476	0.7489	0.7370	0.7489	0.8654
No log	9.1923	478	0.7487	0.7370	0.7487	0.8653
No log	9.2308	480	0.7386	0.7414	0.7386	0.8594
No log	9.2692	482	0.7346	0.7599	0.7346	0.8571
No log	9.3077	484	0.7330	0.7643	0.7330	0.8562
No log	9.3462	486	0.7314	0.7457	0.7314	0.8552
No log	9.3846	488	0.7327	0.7457	0.7327	0.8560
No log	9.4231	490	0.7445	0.7434	0.7445	0.8629
No log	9.4615	492	0.7584	0.7348	0.7584	0.8709
No log	9.5	494	0.7658	0.7348	0.7658	0.8751
No log	9.5385	496	0.7757	0.7348	0.7757	0.8807
No log	9.5769	498	0.7876	0.7246	0.7876	0.8874
0.3159	9.6154	500	0.7980	0.7246	0.7980	0.8933
0.3159	9.6538	502	0.8091	0.6827	0.8091	0.8995
0.3159	9.6923	504	0.8209	0.6827	0.8209	0.9060
0.3159	9.7308	506	0.8242	0.6827	0.8242	0.9078
0.3159	9.7692	508	0.8230	0.6827	0.8230	0.9072
0.3159	9.8077	510	0.8175	0.6827	0.8175	0.9042
0.3159	9.8462	512	0.8142	0.6827	0.8142	0.9023
0.3159	9.8846	514	0.8106	0.6827	0.8106	0.9003
0.3159	9.9231	516	0.8065	0.7046	0.8065	0.8981
0.3159	9.9615	518	0.8042	0.7246	0.8042	0.8968
0.3159	10.0	520	0.8034	0.7246	0.8034	0.8963

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024