ArabicNewSplits2_FineTuningAraBERT_run1_AugV4_k3_task1_organization

MayBashendy/ArabicNewSplits2_FineTuningAraBERT_run1_AugV4_k3_task1_organization

ArabicNewSplits2_FineTuningAraBERT_run1_AugV4_k3_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

17% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 4, 2024
Updated: Dec 4, 2024
SHA: c174b581

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits2_FineTuningAraBERT_run1_AugV4_k3_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.8143
Qwk: 0.6267
Mse: 0.8143
Rmse: 0.9024

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	4.6160	-0.0070	4.6160	2.1485
No log	0.1379	4	2.5931	0.0890	2.5931	1.6103
No log	0.2069	6	1.4979	0.125	1.4979	1.2239
No log	0.2759	8	1.3229	0.0151	1.3229	1.1502
No log	0.3448	10	1.1096	0.4034	1.1096	1.0534
No log	0.4138	12	1.3668	0.25	1.3668	1.1691
No log	0.4828	14	1.4289	0.2696	1.4289	1.1954
No log	0.5517	16	1.2527	0.1959	1.2527	1.1192
No log	0.6207	18	1.3529	0.2725	1.3529	1.1631
No log	0.6897	20	1.7502	0.1850	1.7502	1.3230
No log	0.7586	22	1.7718	0.1571	1.7718	1.3311
No log	0.8276	24	1.6980	0.2251	1.6980	1.3031
No log	0.8966	26	1.5927	0.2681	1.5927	1.2620
No log	0.9655	28	1.5261	0.2721	1.5261	1.2354
No log	1.0345	30	1.3175	0.2263	1.3175	1.1478
No log	1.1034	32	1.2309	0.2392	1.2309	1.1095
No log	1.1724	34	1.4487	0.3378	1.4487	1.2036
No log	1.2414	36	1.8230	0.2607	1.8230	1.3502
No log	1.3103	38	1.8435	0.3302	1.8435	1.3577
No log	1.3793	40	1.4128	0.3445	1.4128	1.1886
No log	1.4483	42	1.0768	0.4358	1.0768	1.0377
No log	1.5172	44	1.0219	0.4787	1.0219	1.0109
No log	1.5862	46	1.0692	0.4931	1.0692	1.0340
No log	1.6552	48	1.3927	0.3244	1.3927	1.1801
No log	1.7241	50	1.4633	0.3244	1.4633	1.2097
No log	1.7931	52	1.5744	0.3333	1.5744	1.2547
No log	1.8621	54	1.4002	0.3885	1.4002	1.1833
No log	1.9310	56	1.0579	0.4167	1.0579	1.0286
No log	2.0	58	0.7240	0.6691	0.7240	0.8509
No log	2.0690	60	0.6796	0.6569	0.6796	0.8244
No log	2.1379	62	0.6943	0.7065	0.6943	0.8333
No log	2.2069	64	0.6831	0.6913	0.6831	0.8265
No log	2.2759	66	0.6947	0.6877	0.6947	0.8335
No log	2.3448	68	0.7085	0.6945	0.7085	0.8417
No log	2.4138	70	0.7616	0.6298	0.7616	0.8727
No log	2.4828	72	0.7857	0.6683	0.7857	0.8864
No log	2.5517	74	0.7473	0.7194	0.7473	0.8645
No log	2.6207	76	0.8332	0.6555	0.8332	0.9128
No log	2.6897	78	0.7839	0.6555	0.7839	0.8854
No log	2.7586	80	0.7104	0.7194	0.7104	0.8429
No log	2.8276	82	0.7091	0.6512	0.7091	0.8421
No log	2.8966	84	0.7215	0.6530	0.7215	0.8494
No log	2.9655	86	0.6844	0.6322	0.6844	0.8273
No log	3.0345	88	0.6814	0.6842	0.6814	0.8255
No log	3.1034	90	0.7733	0.7090	0.7733	0.8794
No log	3.1724	92	0.9269	0.6606	0.9269	0.9628
No log	3.2414	94	0.9376	0.6115	0.9376	0.9683
No log	3.3103	96	0.8340	0.6713	0.8340	0.9133
No log	3.3793	98	0.7134	0.7150	0.7134	0.8446
No log	3.4483	100	0.6788	0.6892	0.6788	0.8239
No log	3.5172	102	0.6735	0.6892	0.6735	0.8207
No log	3.5862	104	0.7885	0.6530	0.7885	0.8880
No log	3.6552	106	1.1824	0.5491	1.1824	1.0874
No log	3.7241	108	1.7261	0.4795	1.7261	1.3138
No log	3.7931	110	1.9038	0.4246	1.9038	1.3798
No log	3.8621	112	1.6044	0.4600	1.6044	1.2666
No log	3.9310	114	1.0961	0.4767	1.0961	1.0469
No log	4.0	116	0.7337	0.6159	0.7337	0.8566
No log	4.0690	118	0.6650	0.6394	0.6650	0.8155
No log	4.1379	120	0.6427	0.6062	0.6427	0.8017
No log	4.2069	122	0.6210	0.6766	0.6210	0.7881
No log	4.2759	124	0.7228	0.6758	0.7228	0.8502
No log	4.3448	126	0.9391	0.6115	0.9391	0.9690
No log	4.4138	128	1.0908	0.5938	1.0908	1.0444
No log	4.4828	130	1.0728	0.6371	1.0728	1.0358
No log	4.5517	132	0.9234	0.6293	0.9234	0.9609
No log	4.6207	134	0.8869	0.6748	0.8869	0.9418
No log	4.6897	136	0.9879	0.5956	0.9879	0.9940
No log	4.7586	138	0.9617	0.5956	0.9617	0.9807
No log	4.8276	140	0.8847	0.6366	0.8847	0.9406
No log	4.8966	142	0.8047	0.7101	0.8047	0.8970
No log	4.9655	144	0.7041	0.6897	0.7041	0.8391
No log	5.0345	146	0.6628	0.6892	0.6628	0.8141
No log	5.1034	148	0.6666	0.6892	0.6666	0.8165
No log	5.1724	150	0.7057	0.7195	0.7057	0.8401
No log	5.2414	152	0.8402	0.6468	0.8402	0.9166
No log	5.3103	154	0.9232	0.5858	0.9232	0.9608
No log	5.3793	156	0.8991	0.5858	0.8991	0.9482
No log	5.4483	158	0.7867	0.6761	0.7867	0.8870
No log	5.5172	160	0.7433	0.7171	0.7433	0.8622
No log	5.5862	162	0.7205	0.7171	0.7205	0.8488
No log	5.6552	164	0.7331	0.7171	0.7331	0.8562
No log	5.7241	166	0.7835	0.6751	0.7835	0.8851
No log	5.7931	168	0.8459	0.6713	0.8459	0.9198
No log	5.8621	170	0.8193	0.6608	0.8193	0.9052
No log	5.9310	172	0.8163	0.6608	0.8163	0.9035
No log	6.0	174	0.7680	0.6441	0.7680	0.8764
No log	6.0690	176	0.7035	0.7097	0.7035	0.8388
No log	6.1379	178	0.6989	0.6795	0.6989	0.8360
No log	6.2069	180	0.7073	0.6984	0.7073	0.8410
No log	6.2759	182	0.7273	0.7097	0.7273	0.8528
No log	6.3448	184	0.7836	0.6521	0.7836	0.8852
No log	6.4138	186	0.8716	0.6155	0.8716	0.9336
No log	6.4828	188	0.9182	0.6155	0.9182	0.9582
No log	6.5517	190	0.9065	0.6155	0.9065	0.9521
No log	6.6207	192	0.8666	0.6155	0.8666	0.9309
No log	6.6897	194	0.8422	0.5844	0.8422	0.9177
No log	6.7586	196	0.8486	0.6136	0.8486	0.9212
No log	6.8276	198	0.8258	0.6504	0.8258	0.9087
No log	6.8966	200	0.8368	0.6322	0.8368	0.9148
No log	6.9655	202	0.8855	0.6310	0.8855	0.9410
No log	7.0345	204	0.9284	0.6310	0.9284	0.9635
No log	7.1034	206	0.9602	0.6199	0.9602	0.9799
No log	7.1724	208	0.9062	0.6216	0.9062	0.9520
No log	7.2414	210	0.7881	0.6817	0.7881	0.8878
No log	7.3103	212	0.7044	0.7210	0.7044	0.8393
No log	7.3793	214	0.6841	0.6909	0.6841	0.8271
No log	7.4483	216	0.6939	0.7210	0.6939	0.8330
No log	7.5172	218	0.7353	0.7262	0.7353	0.8575
No log	7.5862	220	0.7962	0.6479	0.7962	0.8923
No log	7.6552	222	0.8803	0.6216	0.8803	0.9382
No log	7.7241	224	0.8999	0.6216	0.8999	0.9486
No log	7.7931	226	0.8528	0.6667	0.8528	0.9235
No log	7.8621	228	0.8117	0.6778	0.8117	0.9010
No log	7.9310	230	0.8030	0.6889	0.8030	0.8961
No log	8.0	232	0.8290	0.6889	0.8290	0.9105
No log	8.0690	234	0.8912	0.5864	0.8912	0.9440
No log	8.1379	236	0.9140	0.5864	0.9140	0.9560
No log	8.2069	238	0.8959	0.6216	0.8959	0.9465
No log	8.2759	240	0.8624	0.6216	0.8624	0.9287
No log	8.3448	242	0.8583	0.6216	0.8583	0.9264
No log	8.4138	244	0.8505	0.6042	0.8505	0.9222
No log	8.4828	246	0.8756	0.6105	0.8756	0.9357
No log	8.5517	248	0.9087	0.6105	0.9087	0.9533
No log	8.6207	250	0.9436	0.6199	0.9436	0.9714
No log	8.6897	252	0.9422	0.6199	0.9422	0.9707
No log	8.7586	254	0.9118	0.6199	0.9118	0.9549
No log	8.8276	256	0.8691	0.6327	0.8691	0.9322
No log	8.8966	258	0.8445	0.6327	0.8445	0.9190
No log	8.9655	260	0.8204	0.6267	0.8204	0.9057
No log	9.0345	262	0.7873	0.6725	0.7873	0.8873
No log	9.1034	264	0.7631	0.6885	0.7631	0.8736
No log	9.1724	266	0.7527	0.6715	0.7527	0.8676
No log	9.2414	268	0.7509	0.6762	0.7509	0.8666
No log	9.3103	270	0.7558	0.6762	0.7558	0.8694
No log	9.3793	272	0.7662	0.6817	0.7662	0.8753
No log	9.4483	274	0.7786	0.6817	0.7786	0.8824
No log	9.5172	276	0.7843	0.6986	0.7843	0.8856
No log	9.5862	278	0.7889	0.6986	0.7889	0.8882
No log	9.6552	280	0.7954	0.6986	0.7954	0.8918
No log	9.7241	282	0.8005	0.6986	0.8005	0.8947
No log	9.7931	284	0.8051	0.6986	0.8051	0.8973
No log	9.8621	286	0.8088	0.6986	0.8088	0.8993
No log	9.9310	288	0.8127	0.6725	0.8127	0.9015
No log	10.0	290	0.8143	0.6267	0.8143	0.9024

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 4, 2024
Updated: Dec 4, 2024