ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k9_task3_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k9_task3_organization

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k9_task3_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

18% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 9, 2024
Updated: Dec 9, 2024
SHA: f0b779ad

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run2_AugV5_k9_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.7763
Qwk: 0.2227
Mse: 0.7763
Rmse: 0.8811

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0541	2	3.3358	-0.0216	3.3358	1.8264
No log	0.1081	4	1.8521	-0.0640	1.8521	1.3609
No log	0.1622	6	0.9584	0.0431	0.9584	0.9790
No log	0.2162	8	1.6837	0.0345	1.6837	1.2976
No log	0.2703	10	1.0245	0.0388	1.0245	1.0122
No log	0.3243	12	0.6570	0.1304	0.6570	0.8105
No log	0.3784	14	0.6132	-0.0081	0.6132	0.7831
No log	0.4324	16	0.6369	-0.0159	0.6369	0.7981
No log	0.4865	18	0.6398	-0.0233	0.6398	0.7999
No log	0.5405	20	0.6163	0.0	0.6163	0.7851
No log	0.5946	22	0.6195	-0.0159	0.6195	0.7871
No log	0.6486	24	0.6402	-0.0233	0.6402	0.8001
No log	0.7027	26	0.6518	-0.0233	0.6518	0.8074
No log	0.7568	28	0.6615	-0.0233	0.6615	0.8133
No log	0.8108	30	0.7828	0.0164	0.7828	0.8848
No log	0.8649	32	0.9880	-0.0159	0.9880	0.9940
No log	0.9189	34	1.0907	-0.0510	1.0907	1.0444
No log	0.9730	36	0.9262	-0.0041	0.9262	0.9624
No log	1.0270	38	0.7886	0.0476	0.7886	0.8881
No log	1.0811	40	0.6346	-0.0159	0.6346	0.7966
No log	1.1351	42	0.7912	0.0	0.7912	0.8895
No log	1.1892	44	0.7915	0.0	0.7915	0.8897
No log	1.2432	46	0.7522	0.0	0.7522	0.8673
No log	1.2973	48	0.7288	-0.0081	0.7288	0.8537
No log	1.3514	50	0.8149	0.0877	0.8149	0.9027
No log	1.4054	52	1.3574	0.0228	1.3574	1.1651
No log	1.4595	54	1.4616	-0.0380	1.4616	1.2089
No log	1.5135	56	1.2608	0.0	1.2608	1.1229
No log	1.5676	58	1.0845	0.0038	1.0845	1.0414
No log	1.6216	60	0.8528	0.0222	0.8528	0.9235
No log	1.6757	62	0.8665	0.0222	0.8665	0.9308
No log	1.7297	64	1.0636	0.0388	1.0636	1.0313
No log	1.7838	66	1.1821	0.0038	1.1821	1.0872
No log	1.8378	68	0.8342	0.0685	0.8342	0.9133
No log	1.8919	70	0.6374	-0.0909	0.6374	0.7984
No log	1.9459	72	0.6092	-0.0081	0.6092	0.7805
No log	2.0	74	0.6175	-0.0159	0.6175	0.7858
No log	2.0541	76	0.6351	-0.0233	0.6351	0.7969
No log	2.1081	78	0.7290	-0.1701	0.7290	0.8538
No log	2.1622	80	0.9179	0.0476	0.9179	0.9580
No log	2.2162	82	0.9410	0.0042	0.9410	0.9700
No log	2.2703	84	0.8455	-0.0046	0.8455	0.9195
No log	2.3243	86	0.6373	0.0303	0.6373	0.7983
No log	2.3784	88	0.6144	-0.0233	0.6144	0.7838
No log	2.4324	90	0.6263	-0.0233	0.6263	0.7914
No log	2.4865	92	0.6568	-0.0350	0.6568	0.8105
No log	2.5405	94	0.8941	0.0980	0.8941	0.9455
No log	2.5946	96	1.0652	0.0569	1.0652	1.0321
No log	2.6486	98	0.7528	0.1556	0.7528	0.8676
No log	2.7027	100	0.6617	-0.0286	0.6617	0.8134
No log	2.7568	102	0.6659	-0.0803	0.6659	0.8161
No log	2.8108	104	0.7491	0.2088	0.7491	0.8655
No log	2.8649	106	0.7066	-0.0127	0.7066	0.8406
No log	2.9189	108	0.7492	0.0659	0.7492	0.8655
No log	2.9730	110	0.9788	0.1092	0.9788	0.9894
No log	3.0270	112	0.7837	0.1915	0.7837	0.8853
No log	3.0811	114	0.8632	0.0204	0.8632	0.9291
No log	3.1351	116	1.0463	0.0078	1.0463	1.0229
No log	3.1892	118	1.1194	-0.0717	1.1194	1.0580
No log	3.2432	120	0.9774	0.0901	0.9774	0.9886
No log	3.2973	122	0.7620	0.2184	0.7620	0.8729
No log	3.3514	124	1.0833	-0.0265	1.0833	1.0408
No log	3.4054	126	0.8551	0.2000	0.8551	0.9247
No log	3.4595	128	0.9197	0.0189	0.9197	0.9590
No log	3.5135	130	1.1935	0.0872	1.1935	1.0925
No log	3.5676	132	1.1277	0.0725	1.1277	1.0619
No log	3.6216	134	0.8992	-0.0101	0.8992	0.9482
No log	3.6757	136	0.9065	0.1111	0.9065	0.9521
No log	3.7297	138	1.2413	0.0	1.2413	1.1141
No log	3.7838	140	0.9553	0.0654	0.9553	0.9774
No log	3.8378	142	0.7794	0.1059	0.7794	0.8828
No log	3.8919	144	0.9461	0.1416	0.9461	0.9727
No log	3.9459	146	1.0426	0.1318	1.0426	1.0211
No log	4.0	148	0.8978	0.0968	0.8978	0.9475
No log	4.0541	150	0.8311	0.1461	0.8311	0.9117
No log	4.1081	152	0.9344	0.0553	0.9344	0.9666
No log	4.1622	154	0.8468	0.0259	0.8468	0.9202
No log	4.2162	156	1.2542	0.0336	1.2542	1.1199
No log	4.2703	158	1.4649	-0.0210	1.4649	1.2103
No log	4.3243	160	1.3097	-0.0314	1.3097	1.1444
No log	4.3784	162	0.9261	0.0769	0.9261	0.9624
No log	4.4324	164	1.0106	0.0599	1.0106	1.0053
No log	4.4865	166	1.1250	0.0661	1.1250	1.0607
No log	4.5405	168	0.9020	-0.0204	0.9020	0.9497
No log	4.5946	170	0.8821	-0.0162	0.8821	0.9392
No log	4.6486	172	1.0023	0.0393	1.0023	1.0012
No log	4.7027	174	0.9115	0.1220	0.9115	0.9547
No log	4.7568	176	0.8037	0.0703	0.8037	0.8965
No log	4.8108	178	0.8435	0.0674	0.8435	0.9184
No log	4.8649	180	1.0150	0.0800	1.0150	1.0075
No log	4.9189	182	0.9801	0.0259	0.9801	0.9900
No log	4.9730	184	0.9473	-0.0189	0.9473	0.9733
No log	5.0270	186	1.0742	0.0522	1.0742	1.0365
No log	5.0811	188	1.0595	0.0492	1.0595	1.0293
No log	5.1351	190	0.9497	-0.0693	0.9497	0.9745
No log	5.1892	192	0.9469	0.0497	0.9469	0.9731
No log	5.2432	194	1.0886	0.0685	1.0886	1.0434
No log	5.2973	196	1.0383	0.0459	1.0383	1.0190
No log	5.3514	198	0.8798	-0.0370	0.8798	0.9380
No log	5.4054	200	0.9111	0.0884	0.9111	0.9545
No log	5.4595	202	0.9036	0.0512	0.9036	0.9506
No log	5.5135	204	0.8439	0.0249	0.8439	0.9186
No log	5.5676	206	0.8384	0.1568	0.8384	0.9156
No log	5.6216	208	0.8230	0.1568	0.8230	0.9072
No log	5.6757	210	0.8027	0.0053	0.8027	0.8959
No log	5.7297	212	0.8223	0.0316	0.8223	0.9068
No log	5.7838	214	0.7917	0.0667	0.7917	0.8898
No log	5.8378	216	0.7628	0.1724	0.7628	0.8734
No log	5.8919	218	0.8950	0.1269	0.8950	0.9461
No log	5.9459	220	0.8969	0.1269	0.8969	0.9471
No log	6.0	222	0.7734	0.1556	0.7734	0.8794
No log	6.0541	224	0.8558	0.0439	0.8558	0.9251
No log	6.1081	226	1.0258	0.0866	1.0258	1.0128
No log	6.1622	228	1.0116	0.0769	1.0116	1.0058
No log	6.2162	230	0.8902	0.0654	0.8902	0.9435
No log	6.2703	232	0.8586	0.1304	0.8586	0.9266
No log	6.3243	234	0.8556	0.1590	0.8556	0.9250
No log	6.3784	236	0.8422	0.1321	0.8422	0.9177
No log	6.4324	238	0.8315	0.2227	0.8315	0.9119
No log	6.4865	240	0.8933	0.0545	0.8933	0.9452
No log	6.5405	242	1.0267	0.1264	1.0267	1.0132
No log	6.5946	244	0.9864	0.1264	0.9864	0.9932
No log	6.6486	246	0.8365	0.0884	0.8365	0.9146
No log	6.7027	248	0.7480	0.1398	0.7480	0.8649
No log	6.7568	250	0.7777	0.1823	0.7777	0.8819
No log	6.8108	252	0.7515	0.2360	0.7515	0.8669
No log	6.8649	254	0.7278	0.0112	0.7278	0.8531
No log	6.9189	256	0.7692	0.0800	0.7692	0.8770
No log	6.9730	258	0.7499	0.1135	0.7499	0.8660
No log	7.0270	260	0.7083	0.1086	0.7083	0.8416
No log	7.0811	262	0.6909	0.0685	0.6909	0.8312
No log	7.1351	264	0.7062	0.2000	0.7062	0.8403
No log	7.1892	266	0.7153	0.2000	0.7153	0.8458
No log	7.2432	268	0.7183	0.1638	0.7183	0.8475
No log	7.2973	270	0.7277	0.1556	0.7277	0.8531
No log	7.3514	272	0.7282	0.1600	0.7282	0.8534
No log	7.4054	274	0.7840	0.1600	0.7840	0.8854
No log	7.4595	276	0.8320	0.0512	0.8320	0.9121
No log	7.5135	278	0.8234	0.0512	0.8234	0.9074
No log	7.5676	280	0.7815	0.1691	0.7815	0.8840
No log	7.6216	282	0.7785	0.1340	0.7785	0.8823
No log	7.6757	284	0.7797	0.1209	0.7797	0.8830
No log	7.7297	286	0.7592	0.1739	0.7592	0.8713
No log	7.7838	288	0.7409	0.1154	0.7409	0.8607
No log	7.8378	290	0.7778	0.1600	0.7778	0.8819
No log	7.8919	292	0.8073	0.1220	0.8073	0.8985
No log	7.9459	294	0.7890	0.1600	0.7890	0.8882
No log	8.0	296	0.7590	0.1590	0.7590	0.8712
No log	8.0541	298	0.7302	0.1020	0.7302	0.8545
No log	8.1081	300	0.7161	0.1638	0.7161	0.8462
No log	8.1622	302	0.7198	0.1264	0.7198	0.8484
No log	8.2162	304	0.7165	0.1739	0.7165	0.8465
No log	8.2703	306	0.7199	0.1398	0.7199	0.8485
No log	8.3243	308	0.7273	0.1398	0.7273	0.8528
No log	8.3784	310	0.7363	0.1837	0.7363	0.8581
No log	8.4324	312	0.7383	0.1832	0.7383	0.8592
No log	8.4865	314	0.7436	0.3010	0.7436	0.8623
No log	8.5405	316	0.7563	0.2986	0.7563	0.8697
No log	8.5946	318	0.7670	0.3010	0.7670	0.8758
No log	8.6486	320	0.7764	0.2986	0.7764	0.8811
No log	8.7027	322	0.7833	0.2593	0.7833	0.8850
No log	8.7568	324	0.7882	0.1925	0.7882	0.8878
No log	8.8108	326	0.7829	0.2593	0.7829	0.8848
No log	8.8649	328	0.7749	0.2637	0.7749	0.8803
No log	8.9189	330	0.7697	0.2165	0.7697	0.8773
No log	8.9730	332	0.7620	0.2637	0.7620	0.8729
No log	9.0270	334	0.7616	0.2653	0.7616	0.8727
No log	9.0811	336	0.7605	0.2637	0.7605	0.8721
No log	9.1351	338	0.7592	0.2227	0.7592	0.8713
No log	9.1892	340	0.7592	0.2227	0.7592	0.8713
No log	9.2432	342	0.7624	0.1925	0.7624	0.8732
No log	9.2973	344	0.7684	0.0918	0.7684	0.8766
No log	9.3514	346	0.7730	0.0918	0.7730	0.8792
No log	9.4054	348	0.7725	0.0918	0.7725	0.8789
No log	9.4595	350	0.7736	0.1220	0.7736	0.8795
No log	9.5135	352	0.7738	0.1923	0.7738	0.8797
No log	9.5676	354	0.7733	0.2227	0.7733	0.8794
No log	9.6216	356	0.7737	0.2227	0.7737	0.8796
No log	9.6757	358	0.7748	0.1841	0.7748	0.8802
No log	9.7297	360	0.7759	0.1845	0.7759	0.8809
No log	9.7838	362	0.7767	0.2227	0.7767	0.8813
No log	9.8378	364	0.7769	0.2227	0.7769	0.8814
No log	9.8919	366	0.7767	0.2227	0.7767	0.8813
No log	9.9459	368	0.7764	0.2227	0.7764	0.8811
No log	10.0	370	0.7763	0.2227	0.7763	0.8811

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 9, 2024
Updated: Dec 9, 2024