ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k9_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k9_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k9_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

42% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: 5274a818

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k9_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7765
Qwk: 0.1845
Mse: 0.7765
Rmse: 0.8812

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0541	2	3.3358	-0.0216	3.3358	1.8264
No log	0.1081	4	1.8521	-0.0640	1.8521	1.3609
No log	0.1622	6	0.9584	0.0431	0.9584	0.9790
No log	0.2162	8	1.6837	0.0345	1.6837	1.2976
No log	0.2703	10	1.0245	0.0388	1.0245	1.0122
No log	0.3243	12	0.6570	0.1304	0.6570	0.8105
No log	0.3784	14	0.6132	-0.0081	0.6132	0.7831
No log	0.4324	16	0.6369	-0.0159	0.6369	0.7981
No log	0.4865	18	0.6398	-0.0233	0.6398	0.7999
No log	0.5405	20	0.6163	0.0	0.6163	0.7851
No log	0.5946	22	0.6195	-0.0159	0.6195	0.7871
No log	0.6486	24	0.6402	-0.0233	0.6402	0.8001
No log	0.7027	26	0.6518	-0.0233	0.6518	0.8074
No log	0.7568	28	0.6615	-0.0233	0.6615	0.8133
No log	0.8108	30	0.7828	0.0164	0.7828	0.8848
No log	0.8649	32	0.9879	-0.0159	0.9879	0.9939
No log	0.9189	34	1.0907	-0.0510	1.0907	1.0443
No log	0.9730	36	0.9262	-0.0041	0.9262	0.9624
No log	1.0270	38	0.7886	0.0476	0.7886	0.8881
No log	1.0811	40	0.6346	-0.0159	0.6346	0.7966
No log	1.1351	42	0.7912	0.0	0.7912	0.8895
No log	1.1892	44	0.7916	0.0	0.7916	0.8897
No log	1.2432	46	0.7522	0.0	0.7522	0.8673
No log	1.2973	48	0.7288	-0.0081	0.7288	0.8537
No log	1.3514	50	0.8149	0.0877	0.8149	0.9027
No log	1.4054	52	1.3575	0.0228	1.3575	1.1651
No log	1.4595	54	1.4617	-0.0380	1.4617	1.2090
No log	1.5135	56	1.2608	0.0	1.2608	1.1229
No log	1.5676	58	1.0845	0.0038	1.0845	1.0414
No log	1.6216	60	0.8527	0.0222	0.8527	0.9234
No log	1.6757	62	0.8664	0.0222	0.8664	0.9308
No log	1.7297	64	1.0636	0.0388	1.0636	1.0313
No log	1.7838	66	1.1822	0.0038	1.1822	1.0873
No log	1.8378	68	0.8343	0.0685	0.8343	0.9134
No log	1.8919	70	0.6374	-0.0909	0.6374	0.7984
No log	1.9459	72	0.6092	-0.0081	0.6092	0.7805
No log	2.0	74	0.6175	-0.0159	0.6175	0.7858
No log	2.0541	76	0.6351	-0.0233	0.6351	0.7969
No log	2.1081	78	0.7290	-0.1701	0.7290	0.8538
No log	2.1622	80	0.9179	0.0476	0.9179	0.9581
No log	2.2162	82	0.9411	0.0042	0.9411	0.9701
No log	2.2703	84	0.8456	-0.0046	0.8456	0.9196
No log	2.3243	86	0.6374	0.0303	0.6374	0.7983
No log	2.3784	88	0.6144	-0.0233	0.6144	0.7838
No log	2.4324	90	0.6263	-0.0233	0.6263	0.7914
No log	2.4865	92	0.6568	-0.0350	0.6568	0.8104
No log	2.5405	94	0.8939	0.0980	0.8939	0.9455
No log	2.5946	96	1.0651	0.0569	1.0651	1.0320
No log	2.6486	98	0.7527	0.1556	0.7527	0.8676
No log	2.7027	100	0.6617	-0.0286	0.6617	0.8134
No log	2.7568	102	0.6660	-0.0803	0.6660	0.8161
No log	2.8108	104	0.7493	0.2088	0.7493	0.8656
No log	2.8649	106	0.7067	-0.0127	0.7067	0.8406
No log	2.9189	108	0.7493	0.0659	0.7493	0.8656
No log	2.9730	110	0.9788	0.1092	0.9788	0.9893
No log	3.0270	112	0.7836	0.1915	0.7836	0.8852
No log	3.0811	114	0.8631	0.0204	0.8631	0.9290
No log	3.1351	116	1.0460	0.0078	1.0460	1.0227
No log	3.1892	118	1.1191	-0.0717	1.1191	1.0579
No log	3.2432	120	0.9767	0.0901	0.9767	0.9883
No log	3.2973	122	0.7624	0.2184	0.7624	0.8731
No log	3.3514	124	1.0817	-0.0265	1.0817	1.0401
No log	3.4054	126	0.8542	0.2000	0.8542	0.9242
No log	3.4595	128	0.9210	0.0189	0.9210	0.9597
No log	3.5135	130	1.1939	0.0872	1.1939	1.0926
No log	3.5676	132	1.1270	0.0725	1.1270	1.0616
No log	3.6216	134	0.8990	-0.0570	0.8990	0.9482
No log	3.6757	136	0.9057	0.1111	0.9057	0.9517
No log	3.7297	138	1.2340	0.0	1.2340	1.1109
No log	3.7838	140	0.9476	0.0800	0.9476	0.9734
No log	3.8378	142	0.7830	0.1059	0.7830	0.8849
No log	3.8919	144	0.9495	0.1416	0.9495	0.9744
No log	3.9459	146	1.0399	0.1318	1.0399	1.0197
No log	4.0	148	0.8914	0.0968	0.8914	0.9442
No log	4.0541	150	0.8335	0.1461	0.8335	0.9130
No log	4.1081	152	0.9197	0.0612	0.9197	0.9590
No log	4.1622	154	0.8552	0.1133	0.8552	0.9248
No log	4.2162	156	1.3038	0.0390	1.3038	1.1418
No log	4.2703	158	1.5093	-0.0178	1.5093	1.2285
No log	4.3243	160	1.3607	-0.0314	1.3607	1.1665
No log	4.3784	162	0.9669	0.0909	0.9669	0.9833
No log	4.4324	164	0.9710	0.0385	0.9710	0.9854
No log	4.4865	166	1.0872	0.0407	1.0872	1.0427
No log	4.5405	168	0.8950	-0.0417	0.8950	0.9461
No log	4.5946	170	0.9005	-0.0162	0.9005	0.9489
No log	4.6486	172	1.0105	0.0393	1.0105	1.0052
No log	4.7027	174	0.9110	0.1220	0.9110	0.9545
No log	4.7568	176	0.8079	0.0316	0.8079	0.8988
No log	4.8108	178	0.8402	0.0674	0.8402	0.9166
No log	4.8649	180	0.9913	0.0612	0.9913	0.9956
No log	4.9189	182	0.9585	0.0802	0.9585	0.9790
No log	4.9730	184	0.9442	-0.0189	0.9442	0.9717
No log	5.0270	186	1.0575	0.0522	1.0575	1.0283
No log	5.0811	188	1.0356	0.0460	1.0356	1.0176
No log	5.1351	190	0.9401	-0.0693	0.9401	0.9696
No log	5.1892	192	0.9495	0.1011	0.9495	0.9744
No log	5.2432	194	1.0599	0.0407	1.0599	1.0295
No log	5.2973	196	0.9969	0.0707	0.9969	0.9985
No log	5.3514	198	0.8817	-0.0872	0.8817	0.9390
No log	5.4054	200	0.9169	0.0512	0.9169	0.9576
No log	5.4595	202	0.8890	0.0	0.8890	0.9429
No log	5.5135	204	0.8489	0.0531	0.8489	0.9214
No log	5.5676	206	0.8410	0.1489	0.8410	0.9170
No log	5.6216	208	0.8081	0.1568	0.8081	0.8989
No log	5.6757	210	0.8062	0.0196	0.8062	0.8979
No log	5.7297	212	0.8164	-0.0417	0.8164	0.9036
No log	5.7838	214	0.7854	0.0171	0.7854	0.8862
No log	5.8378	216	0.7728	0.2090	0.7728	0.8791
No log	5.8919	218	0.9256	0.1068	0.9256	0.9621
No log	5.9459	220	0.9201	0.1388	0.9201	0.9592
No log	6.0	222	0.7807	0.1913	0.7807	0.8836
No log	6.0541	224	0.8640	0.0095	0.8640	0.9295
No log	6.1081	226	1.0520	0.1197	1.0520	1.0257
No log	6.1622	228	1.0486	0.0866	1.0486	1.0240
No log	6.2162	230	0.9155	0.0370	0.9155	0.9568
No log	6.2703	232	0.8622	0.0622	0.8622	0.9286
No log	6.3243	234	0.8496	0.1304	0.8496	0.9217
No log	6.3784	236	0.8377	0.1321	0.8377	0.9153
No log	6.4324	238	0.8322	0.1610	0.8322	0.9123
No log	6.4865	240	0.9192	0.1000	0.9192	0.9588
No log	6.5405	242	1.0072	0.125	1.0072	1.0036
No log	6.5946	244	0.9293	0.0866	0.9293	0.9640
No log	6.6486	246	0.7848	0.1590	0.7848	0.8859
No log	6.7027	248	0.7739	0.1823	0.7739	0.8797
No log	6.7568	250	0.8238	0.1020	0.8238	0.9077
No log	6.8108	252	0.7716	0.2360	0.7716	0.8784
No log	6.8649	254	0.7281	-0.0405	0.7281	0.8533
No log	6.9189	256	0.7821	0.1336	0.7821	0.8844
No log	6.9730	258	0.7713	0.0918	0.7713	0.8783
No log	7.0270	260	0.7237	0.1135	0.7237	0.8507
No log	7.0811	262	0.6931	0.0769	0.6931	0.8325
No log	7.1351	264	0.7093	0.2360	0.7093	0.8422
No log	7.1892	266	0.7238	0.2360	0.7238	0.8508
No log	7.2432	268	0.7226	0.2000	0.7226	0.8501
No log	7.2973	270	0.7297	0.1913	0.7297	0.8542
No log	7.3514	272	0.7234	0.1111	0.7234	0.8505
No log	7.4054	274	0.7840	0.1220	0.7840	0.8854
No log	7.4595	276	0.8345	0.0933	0.8345	0.9135
No log	7.5135	278	0.8403	0.0933	0.8403	0.9167
No log	7.5676	280	0.7981	0.1220	0.7981	0.8934
No log	7.6216	282	0.7693	0.1619	0.7693	0.8771
No log	7.6757	284	0.7576	0.1373	0.7576	0.8704
No log	7.7297	286	0.7425	0.1759	0.7425	0.8617
No log	7.7838	288	0.7313	0.0374	0.7313	0.8551
No log	7.8378	290	0.7621	0.1590	0.7621	0.8730
No log	7.8919	292	0.7788	0.1220	0.7788	0.8825
No log	7.9459	294	0.7612	0.1600	0.7612	0.8725
No log	8.0	296	0.7397	0.1590	0.7397	0.8600
No log	8.0541	298	0.7286	0.1088	0.7286	0.8536
No log	8.1081	300	0.7167	0.0497	0.7167	0.8466
No log	8.1622	302	0.7130	-0.0058	0.7130	0.8444
No log	8.2162	304	0.7149	0.0455	0.7149	0.8455
No log	8.2703	306	0.7313	0.1443	0.7313	0.8551
No log	8.3243	308	0.7389	0.1443	0.7389	0.8596
No log	8.3784	310	0.7464	0.1443	0.7464	0.8639
No log	8.4324	312	0.7450	0.2381	0.7450	0.8631
No log	8.4865	314	0.7502	0.2637	0.7502	0.8661
No log	8.5405	316	0.7634	0.2986	0.7634	0.8737
No log	8.5946	318	0.7743	0.2986	0.7743	0.8800
No log	8.6486	320	0.7853	0.2593	0.7853	0.8862
No log	8.7027	322	0.7935	0.1925	0.7935	0.8908
No log	8.7568	324	0.8019	0.0918	0.8019	0.8955
No log	8.8108	326	0.7926	0.1925	0.7926	0.8903
No log	8.8649	328	0.7804	0.2986	0.7804	0.8834
No log	8.9189	330	0.7739	0.1746	0.7739	0.8797
No log	8.9730	332	0.7669	0.2245	0.7669	0.8757
No log	9.0270	334	0.7664	0.2251	0.7664	0.8754
No log	9.0811	336	0.7646	0.2239	0.7646	0.8744
No log	9.1351	338	0.7630	0.2227	0.7630	0.8735
No log	9.1892	340	0.7626	0.2227	0.7626	0.8732
No log	9.2432	342	0.7665	0.1238	0.7665	0.8755
No log	9.2973	344	0.7744	0.0918	0.7744	0.8800
No log	9.3514	346	0.7801	0.0980	0.7801	0.8832
No log	9.4054	348	0.7780	0.0918	0.7780	0.8821
No log	9.4595	350	0.7765	0.0918	0.7765	0.8812
No log	9.5135	352	0.7748	0.1220	0.7748	0.8802
No log	9.5676	354	0.7735	0.1845	0.7735	0.8795
No log	9.6216	356	0.7738	0.1845	0.7738	0.8797
No log	9.6757	358	0.7753	0.1837	0.7753	0.8805
No log	9.7297	360	0.7764	0.1837	0.7764	0.8811
No log	9.7838	362	0.7770	0.1443	0.7770	0.8815
No log	9.8378	364	0.7771	0.1845	0.7771	0.8816
No log	9.8919	366	0.7769	0.1845	0.7769	0.8814
No log	9.9459	368	0.7766	0.1845	0.7766	0.8812
No log	10.0	370	0.7765	0.1845	0.7765	0.8812

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024