ArabicNewSplits2_FineTuningAraBERT_run1_AugV5_k10_task1_organization

MayBashendy/ArabicNewSplits2_FineTuningAraBERT_run1_AugV5_k10_task1_organization

ArabicNewSplits2_FineTuningAraBERT_run1_AugV5_k10_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

39% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 1, 2024
Updated: Dec 1, 2024
SHA: 0bc6c6f8

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits2_FineTuningAraBERT_run1_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.6663
Qwk: 0.712
Mse: 0.6663
Rmse: 0.8163

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0455	2	4.6832	-0.0151	4.6832	2.1641
No log	0.0909	4	2.6634	0.0693	2.6634	1.6320
No log	0.1364	6	1.7067	0.1254	1.7067	1.3064
No log	0.1818	8	1.2997	0.1276	1.2997	1.1400
No log	0.2273	10	1.7084	0.1476	1.7084	1.3071
No log	0.2727	12	1.7248	0.1879	1.7248	1.3133
No log	0.3182	14	1.2748	0.2419	1.2748	1.1290
No log	0.3636	16	1.0981	0.3713	1.0981	1.0479
No log	0.4091	18	1.1842	0.2230	1.1842	1.0882
No log	0.4545	20	1.3938	0.1590	1.3938	1.1806
No log	0.5	22	1.3691	0.1295	1.3691	1.1701
No log	0.5455	24	1.3804	0.1295	1.3804	1.1749
No log	0.5909	26	1.2704	0.2449	1.2704	1.1271
No log	0.6364	28	1.1560	0.3460	1.1560	1.0752
No log	0.6818	30	1.1596	0.3460	1.1596	1.0768
No log	0.7273	32	1.0620	0.4559	1.0620	1.0305
No log	0.7727	34	1.0406	0.4748	1.0406	1.0201
No log	0.8182	36	1.0053	0.5443	1.0053	1.0026
No log	0.8636	38	0.8896	0.5414	0.8896	0.9432
No log	0.9091	40	0.7812	0.4968	0.7812	0.8839
No log	0.9545	42	0.7851	0.4968	0.7851	0.8860
No log	1.0	44	0.8545	0.5702	0.8545	0.9244
No log	1.0455	46	1.1387	0.5363	1.1387	1.0671
No log	1.0909	48	1.1322	0.5363	1.1322	1.0640
No log	1.1364	50	0.7678	0.6117	0.7678	0.8762
No log	1.1818	52	0.6732	0.6417	0.6732	0.8205
No log	1.2273	54	0.8035	0.5017	0.8035	0.8964
No log	1.2727	56	0.6991	0.5441	0.6991	0.8361
No log	1.3182	58	0.5886	0.6963	0.5886	0.7672
No log	1.3636	60	0.7887	0.5898	0.7887	0.8881
No log	1.4091	62	1.0384	0.5135	1.0384	1.0190
No log	1.4545	64	0.9773	0.5116	0.9773	0.9886
No log	1.5	66	0.7647	0.5728	0.7647	0.8745
No log	1.5455	68	0.6751	0.6061	0.6751	0.8216
No log	1.5909	70	0.7339	0.5880	0.7339	0.8567
No log	1.6364	72	0.7876	0.5606	0.7876	0.8875
No log	1.6818	74	0.7370	0.5451	0.7370	0.8585
No log	1.7273	76	0.6968	0.5661	0.6968	0.8348
No log	1.7727	78	0.7166	0.5381	0.7166	0.8465
No log	1.8182	80	0.6885	0.5985	0.6885	0.8298
No log	1.8636	82	0.6830	0.6954	0.6830	0.8265
No log	1.9091	84	0.8077	0.5388	0.8077	0.8987
No log	1.9545	86	0.8289	0.5168	0.8289	0.9104
No log	2.0	88	0.7108	0.6026	0.7108	0.8431
No log	2.0455	90	0.6132	0.7846	0.6132	0.7831
No log	2.0909	92	0.6378	0.688	0.6378	0.7986
No log	2.1364	94	0.6665	0.6935	0.6665	0.8164
No log	2.1818	96	0.6457	0.7227	0.6457	0.8036
No log	2.2273	98	0.6311	0.7135	0.6311	0.7944
No log	2.2727	100	0.5762	0.7425	0.5762	0.7591
No log	2.3182	102	0.5875	0.6985	0.5875	0.7665
No log	2.3636	104	0.6434	0.6985	0.6434	0.8021
No log	2.4091	106	0.5812	0.7173	0.5812	0.7624
No log	2.4545	108	0.5717	0.7778	0.5717	0.7561
No log	2.5	110	0.5702	0.7846	0.5702	0.7551
No log	2.5455	112	0.5767	0.7520	0.5767	0.7594
No log	2.5909	114	0.5569	0.7105	0.5569	0.7462
No log	2.6364	116	0.5730	0.6471	0.5730	0.7570
No log	2.6818	118	0.6526	0.6287	0.6526	0.8078
No log	2.7273	120	0.7347	0.6121	0.7347	0.8571
No log	2.7727	122	0.8016	0.5614	0.8016	0.8953
No log	2.8182	124	0.7977	0.5216	0.7977	0.8931
No log	2.8636	126	0.7047	0.5952	0.7047	0.8395
No log	2.9091	128	0.6042	0.6311	0.6042	0.7773
No log	2.9545	130	0.5920	0.6725	0.5920	0.7694
No log	3.0	132	0.5644	0.6517	0.5644	0.7513
No log	3.0455	134	0.5476	0.6591	0.5476	0.7400
No log	3.0909	136	0.5640	0.7203	0.5640	0.7510
No log	3.1364	138	0.5692	0.6725	0.5692	0.7544
No log	3.1818	140	0.5354	0.7608	0.5354	0.7317
No log	3.2273	142	0.5938	0.7283	0.5938	0.7706
No log	3.2727	144	0.5680	0.7533	0.5680	0.7536
No log	3.3182	146	0.5480	0.7319	0.5480	0.7402
No log	3.3636	148	0.6089	0.6860	0.6089	0.7803
No log	3.4091	150	0.6351	0.6860	0.6351	0.7969
No log	3.4545	152	0.5981	0.7339	0.5981	0.7734
No log	3.5	154	0.5756	0.7353	0.5756	0.7587
No log	3.5455	156	0.5744	0.7450	0.5744	0.7579
No log	3.5909	158	0.6088	0.6777	0.6088	0.7802
No log	3.6364	160	0.6180	0.6777	0.6180	0.7861
No log	3.6818	162	0.5642	0.6672	0.5642	0.7511
No log	3.7273	164	0.5367	0.7331	0.5367	0.7326
No log	3.7727	166	0.5228	0.7664	0.5228	0.7230
No log	3.8182	168	0.5151	0.7619	0.5151	0.7177
No log	3.8636	170	0.5251	0.7756	0.5251	0.7246
No log	3.9091	172	0.5234	0.7543	0.5234	0.7235
No log	3.9545	174	0.5977	0.6881	0.5977	0.7731
No log	4.0	176	0.7361	0.6761	0.7361	0.8580
No log	4.0455	178	0.7461	0.6466	0.7461	0.8638
No log	4.0909	180	0.6434	0.6705	0.6434	0.8021
No log	4.1364	182	0.6056	0.7415	0.6056	0.7782
No log	4.1818	184	0.6029	0.7319	0.6029	0.7765
No log	4.2273	186	0.5904	0.7583	0.5904	0.7684
No log	4.2727	188	0.6504	0.6719	0.6504	0.8065
No log	4.3182	190	0.6703	0.6828	0.6703	0.8187
No log	4.3636	192	0.6093	0.6719	0.6093	0.7806
No log	4.4091	194	0.5423	0.7324	0.5423	0.7364
No log	4.4545	196	0.5051	0.7188	0.5051	0.7107
No log	4.5	198	0.5448	0.7227	0.5448	0.7381
No log	4.5455	200	0.5196	0.6920	0.5196	0.7209
No log	4.5909	202	0.5118	0.7041	0.5118	0.7154
No log	4.6364	204	0.6130	0.6451	0.6130	0.7829
No log	4.6818	206	0.6440	0.5848	0.6440	0.8025
No log	4.7273	208	0.5930	0.6143	0.5930	0.7701
No log	4.7727	210	0.5896	0.6143	0.5896	0.7678
No log	4.8182	212	0.5756	0.7009	0.5756	0.7587
No log	4.8636	214	0.5822	0.6870	0.5822	0.7630
No log	4.9091	216	0.5855	0.7009	0.5855	0.7652
No log	4.9545	218	0.5795	0.6805	0.5795	0.7612
No log	5.0	220	0.6000	0.6497	0.6000	0.7746
No log	5.0455	222	0.6708	0.6431	0.6708	0.8190
No log	5.0909	224	0.6952	0.65	0.6952	0.8338
No log	5.1364	226	0.5971	0.6576	0.5971	0.7727
No log	5.1818	228	0.5279	0.7147	0.5279	0.7266
No log	5.2273	230	0.5317	0.7284	0.5317	0.7292
No log	5.2727	232	0.5818	0.6510	0.5818	0.7627
No log	5.3182	234	0.7183	0.6271	0.7183	0.8475
No log	5.3636	236	0.7784	0.5645	0.7784	0.8823
No log	5.4091	238	0.7412	0.5823	0.7412	0.8609
No log	5.4545	240	0.7076	0.5727	0.7076	0.8412
No log	5.5	242	0.7259	0.5848	0.7259	0.8520
No log	5.5455	244	0.7088	0.5980	0.7088	0.8419
No log	5.5909	246	0.6307	0.6375	0.6307	0.7941
No log	5.6364	248	0.5926	0.6824	0.5926	0.7698
No log	5.6818	250	0.5931	0.6824	0.5931	0.7701
No log	5.7273	252	0.5900	0.6611	0.5900	0.7681
No log	5.7727	254	0.6008	0.6730	0.6008	0.7751
No log	5.8182	256	0.5982	0.6730	0.5982	0.7734
No log	5.8636	258	0.6015	0.6766	0.6015	0.7756
No log	5.9091	260	0.5892	0.6549	0.5892	0.7676
No log	5.9545	262	0.5605	0.6805	0.5605	0.7487
No log	6.0	264	0.5569	0.6411	0.5569	0.7462
No log	6.0455	266	0.5550	0.6411	0.5550	0.7450
No log	6.0909	268	0.5447	0.6411	0.5447	0.7380
No log	6.1364	270	0.5542	0.6560	0.5542	0.7445
No log	6.1818	272	0.5341	0.6632	0.5341	0.7308
No log	6.2273	274	0.5349	0.6947	0.5349	0.7314
No log	6.2727	276	0.5454	0.6805	0.5454	0.7385
No log	6.3182	278	0.5440	0.6947	0.5440	0.7376
No log	6.3636	280	0.5524	0.6465	0.5524	0.7432
No log	6.4091	282	0.5689	0.6465	0.5689	0.7542
No log	6.4545	284	0.6054	0.6749	0.6054	0.7781
No log	6.5	286	0.6419	0.6759	0.6419	0.8012
No log	6.5455	288	0.6992	0.6431	0.6992	0.8362
No log	6.5909	290	0.8086	0.6585	0.8086	0.8992
No log	6.6364	292	0.9052	0.5742	0.9052	0.9514
No log	6.6818	294	0.9516	0.5138	0.9516	0.9755
No log	6.7273	296	0.8760	0.5763	0.8760	0.9360
No log	6.7727	298	0.7846	0.6846	0.7846	0.8858
No log	6.8182	300	0.7651	0.6811	0.7651	0.8747
No log	6.8636	302	0.7497	0.7063	0.7497	0.8658
No log	6.9091	304	0.7597	0.6846	0.7597	0.8716
No log	6.9545	306	0.7354	0.7063	0.7354	0.8575
No log	7.0	308	0.7389	0.6604	0.7389	0.8596
No log	7.0455	310	0.7252	0.7252	0.7252	0.8516
No log	7.0909	312	0.7475	0.6604	0.7475	0.8646
No log	7.1364	314	0.7592	0.6519	0.7592	0.8713
No log	7.1818	316	0.7635	0.6314	0.7635	0.8738
No log	7.2273	318	0.7447	0.6587	0.7447	0.8629
No log	7.2727	320	0.7323	0.6003	0.7323	0.8558
No log	7.3182	322	0.7286	0.6471	0.7286	0.8536
No log	7.3636	324	0.7108	0.6444	0.7108	0.8431
No log	7.4091	326	0.6819	0.6463	0.6819	0.8258
No log	7.4545	328	0.6755	0.6463	0.6755	0.8219
No log	7.5	330	0.7104	0.6751	0.7104	0.8429
No log	7.5455	332	0.7287	0.6976	0.7287	0.8536
No log	7.5909	334	0.7789	0.6447	0.7789	0.8826
No log	7.6364	336	0.7850	0.6319	0.7850	0.8860
No log	7.6818	338	0.7583	0.6976	0.7583	0.8708
No log	7.7273	340	0.7353	0.6976	0.7353	0.8575
No log	7.7727	342	0.7188	0.6937	0.7188	0.8478
No log	7.8182	344	0.7007	0.6953	0.7007	0.8371
No log	7.8636	346	0.7095	0.6828	0.7095	0.8423
No log	7.9091	348	0.6823	0.6220	0.6823	0.8260
No log	7.9545	350	0.6488	0.6186	0.6488	0.8055
No log	8.0	352	0.6292	0.6110	0.6292	0.7932
No log	8.0455	354	0.6296	0.6110	0.6296	0.7935
No log	8.0909	356	0.6453	0.5968	0.6453	0.8033
No log	8.1364	358	0.6650	0.6186	0.6650	0.8155
No log	8.1818	360	0.7083	0.6640	0.7083	0.8416
No log	8.2273	362	0.7830	0.6976	0.7830	0.8849
No log	8.2727	364	0.8579	0.6076	0.8579	0.9262
No log	8.3182	366	0.8996	0.5536	0.8996	0.9485
No log	8.3636	368	0.9120	0.5276	0.9120	0.9550
No log	8.4091	370	0.8716	0.5909	0.8716	0.9336
No log	8.4545	372	0.7975	0.6447	0.7975	0.8930
No log	8.5	374	0.7158	0.6937	0.7158	0.8460
No log	8.5455	376	0.6467	0.7078	0.6467	0.8042
No log	8.5909	378	0.6103	0.6777	0.6103	0.7812
No log	8.6364	380	0.5946	0.6110	0.5946	0.7711
No log	8.6818	382	0.5882	0.625	0.5882	0.7670
No log	8.7273	384	0.5878	0.6577	0.5878	0.7667
No log	8.7727	386	0.5942	0.6777	0.5942	0.7709
No log	8.8182	388	0.6118	0.6644	0.6118	0.7822
No log	8.8636	390	0.6383	0.6897	0.6383	0.7989
No log	8.9091	392	0.6600	0.6828	0.6600	0.8124
No log	8.9545	394	0.6667	0.6937	0.6667	0.8165
No log	9.0	396	0.6650	0.6937	0.6650	0.8155
No log	9.0455	398	0.6501	0.7008	0.6501	0.8063
No log	9.0909	400	0.6387	0.6897	0.6387	0.7992
No log	9.1364	402	0.6412	0.7008	0.6412	0.8008
No log	9.1818	404	0.6507	0.7008	0.6507	0.8066
No log	9.2273	406	0.6552	0.7008	0.6552	0.8094
No log	9.2727	408	0.6569	0.7008	0.6569	0.8105
No log	9.3182	410	0.6504	0.7008	0.6504	0.8065
No log	9.3636	412	0.6437	0.6897	0.6437	0.8023
No log	9.4091	414	0.6444	0.6897	0.6444	0.8027
No log	9.4545	416	0.6495	0.7008	0.6495	0.8059
No log	9.5	418	0.6523	0.7008	0.6523	0.8077
No log	9.5455	420	0.6566	0.7008	0.6566	0.8103
No log	9.5909	422	0.6621	0.712	0.6621	0.8137
No log	9.6364	424	0.6640	0.712	0.6640	0.8149
No log	9.6818	426	0.6653	0.712	0.6653	0.8157
No log	9.7273	428	0.6677	0.712	0.6677	0.8171
No log	9.7727	430	0.6683	0.712	0.6683	0.8175
No log	9.8182	432	0.6667	0.712	0.6667	0.8165
No log	9.8636	434	0.6662	0.712	0.6662	0.8162
No log	9.9091	436	0.6663	0.712	0.6663	0.8163
No log	9.9545	438	0.6664	0.712	0.6664	0.8164
No log	10.0	440	0.6663	0.712	0.6663	0.8163

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 1, 2024
Updated: Dec 1, 2024