ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k10_task1_organization

MayBashendy/ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k10_task1_organization

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k10_task1_organization is a text classification model from MayBashendy. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

59% of all-time downloads

All-time downloads

Public

Parameters

135M

541 MB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors541 MB · 100%

At a glance

Task: Text Classification
Library: transformers
Model type: bert
Access: Public
Created: Dec 8, 2024
Updated: Dec 8, 2024
SHA: cabd531e

Try a prompt

Base models

aubmindlab/bert-base-arabertv02

Model card

From the Hugging Face model README

ArabicNewSplits4_FineTuningAraBERT_run1_AugV5_k10_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.8521
Qwk: 0.6917
Mse: 0.8521
Rmse: 0.9231

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 10

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0426	2	5.1279	-0.0180	5.1279	2.2645
No log	0.0851	4	3.6929	0.0656	3.6929	1.9217
No log	0.1277	6	2.0403	0.1209	2.0403	1.4284
No log	0.1702	8	1.6768	0.0546	1.6768	1.2949
No log	0.2128	10	1.4867	0.0598	1.4867	1.2193
No log	0.2553	12	1.3116	0.1438	1.3116	1.1452
No log	0.2979	14	1.1513	0.2318	1.1513	1.0730
No log	0.3404	16	1.1188	0.2733	1.1188	1.0578
No log	0.3830	18	1.1291	0.2742	1.1291	1.0626
No log	0.4255	20	1.1960	0.2761	1.1960	1.0936
No log	0.4681	22	1.3708	0.0633	1.3708	1.1708
No log	0.5106	24	1.5770	0.0990	1.5770	1.2558
No log	0.5532	26	1.4462	0.0824	1.4462	1.2026
No log	0.5957	28	1.1319	0.3891	1.1319	1.0639
No log	0.6383	30	0.9528	0.3725	0.9528	0.9761
No log	0.6809	32	1.0938	0.2453	1.0938	1.0459
No log	0.7234	34	1.1703	0.1999	1.1703	1.0818
No log	0.7660	36	1.1302	0.1999	1.1302	1.0631
No log	0.8085	38	0.9932	0.3164	0.9932	0.9966
No log	0.8511	40	1.0009	0.3164	1.0009	1.0005
No log	0.8936	42	0.9852	0.3397	0.9852	0.9926
No log	0.9362	44	0.9900	0.4129	0.9900	0.9950
No log	0.9787	46	0.9795	0.4143	0.9795	0.9897
No log	1.0213	48	0.9217	0.4246	0.9217	0.9600
No log	1.0638	50	0.8735	0.4005	0.8735	0.9346
No log	1.1064	52	0.9022	0.3200	0.9022	0.9498
No log	1.1489	54	0.8661	0.4061	0.8661	0.9307
No log	1.1915	56	0.8725	0.4435	0.8725	0.9341
No log	1.2340	58	0.8481	0.475	0.8481	0.9209
No log	1.2766	60	0.8173	0.4507	0.8173	0.9040
No log	1.3191	62	0.7926	0.5003	0.7926	0.8903
No log	1.3617	64	0.7838	0.5310	0.7838	0.8853
No log	1.4043	66	0.7428	0.5815	0.7428	0.8618
No log	1.4468	68	0.7296	0.5970	0.7296	0.8542
No log	1.4894	70	0.7107	0.6241	0.7107	0.8430
No log	1.5319	72	0.7272	0.5944	0.7272	0.8527
No log	1.5745	74	0.6994	0.6096	0.6994	0.8363
No log	1.6170	76	0.6764	0.6354	0.6764	0.8224
No log	1.6596	78	0.6748	0.6721	0.6748	0.8215
No log	1.7021	80	0.7242	0.6886	0.7242	0.8510
No log	1.7447	82	0.6636	0.6941	0.6636	0.8146
No log	1.7872	84	0.7581	0.6102	0.7581	0.8707
No log	1.8298	86	0.9291	0.5473	0.9291	0.9639
No log	1.8723	88	0.8398	0.6186	0.8398	0.9164
No log	1.9149	90	0.6950	0.6944	0.6950	0.8337
No log	1.9574	92	0.6213	0.7140	0.6213	0.7882
No log	2.0	94	0.6133	0.6954	0.6133	0.7831
No log	2.0426	96	0.6075	0.7016	0.6075	0.7794
No log	2.0851	98	0.5967	0.7224	0.5967	0.7725
No log	2.1277	100	0.6568	0.6960	0.6568	0.8105
No log	2.1702	102	0.7575	0.6651	0.7575	0.8703
No log	2.2128	104	0.8331	0.6029	0.8331	0.9128
No log	2.2553	106	0.9189	0.5738	0.9189	0.9586
No log	2.2979	108	0.9837	0.5610	0.9837	0.9918
No log	2.3404	110	0.9561	0.5825	0.9561	0.9778
No log	2.3830	112	0.8187	0.6894	0.8187	0.9048
No log	2.4255	114	0.8238	0.6756	0.8238	0.9076
No log	2.4681	116	0.9585	0.5725	0.9585	0.9790
No log	2.5106	118	1.0621	0.5218	1.0621	1.0306
No log	2.5532	120	1.0641	0.5476	1.0641	1.0316
No log	2.5957	122	0.9493	0.6029	0.9493	0.9743
No log	2.6383	124	0.8120	0.6624	0.8120	0.9011
No log	2.6809	126	0.8006	0.6656	0.8006	0.8948
No log	2.7234	128	0.7713	0.6580	0.7713	0.8783
No log	2.7660	130	0.8213	0.6735	0.8213	0.9062
No log	2.8085	132	0.8466	0.6568	0.8466	0.9201
No log	2.8511	134	0.9497	0.6379	0.9497	0.9745
No log	2.8936	136	1.0473	0.6169	1.0473	1.0234
No log	2.9362	138	1.0019	0.6098	1.0019	1.0010
No log	2.9787	140	0.8774	0.6442	0.8774	0.9367
No log	3.0213	142	0.8048	0.6889	0.8048	0.8971
No log	3.0638	144	0.8408	0.6710	0.8408	0.9170
No log	3.1064	146	0.9106	0.6251	0.9106	0.9543
No log	3.1489	148	0.9726	0.6165	0.9726	0.9862
No log	3.1915	150	0.9969	0.5802	0.9969	0.9985
No log	3.2340	152	0.9859	0.5626	0.9859	0.9929
No log	3.2766	154	0.9067	0.6060	0.9067	0.9522
No log	3.3191	156	0.7484	0.6533	0.7484	0.8651
No log	3.3617	158	0.6826	0.6621	0.6826	0.8262
No log	3.4043	160	0.6675	0.6582	0.6675	0.8170
No log	3.4468	162	0.6784	0.7040	0.6784	0.8236
No log	3.4894	164	0.7051	0.7173	0.7051	0.8397
No log	3.5319	166	0.7919	0.6784	0.7919	0.8899
No log	3.5745	168	0.8727	0.6753	0.8727	0.9342
No log	3.6170	170	0.9906	0.6548	0.9906	0.9953
No log	3.6596	172	0.9640	0.6641	0.9640	0.9818
No log	3.7021	174	0.9107	0.6641	0.9107	0.9543
No log	3.7447	176	0.8432	0.6669	0.8432	0.9183
No log	3.7872	178	0.8156	0.6637	0.8156	0.9031
No log	3.8298	180	0.7643	0.6962	0.7643	0.8742
No log	3.8723	182	0.7410	0.7018	0.7410	0.8608
No log	3.9149	184	0.7211	0.7018	0.7211	0.8492
No log	3.9574	186	0.7265	0.7121	0.7265	0.8523
No log	4.0	188	0.8014	0.6863	0.8014	0.8952
No log	4.0426	190	0.8592	0.6706	0.8592	0.9269
No log	4.0851	192	0.8645	0.6583	0.8645	0.9298
No log	4.1277	194	0.8070	0.6953	0.8070	0.8983
No log	4.1702	196	0.7294	0.7229	0.7294	0.8540
No log	4.2128	198	0.6958	0.7315	0.6958	0.8341
No log	4.2553	200	0.7016	0.7169	0.7016	0.8376
No log	4.2979	202	0.7355	0.6997	0.7355	0.8576
No log	4.3404	204	0.8392	0.6966	0.8392	0.9161
No log	4.3830	206	1.0293	0.6078	1.0293	1.0145
No log	4.4255	208	1.1040	0.5713	1.1040	1.0507
No log	4.4681	210	1.0442	0.5856	1.0442	1.0219
No log	4.5106	212	0.8839	0.6597	0.8839	0.9401
No log	4.5532	214	0.7750	0.6942	0.7750	0.8803
No log	4.5957	216	0.7731	0.7001	0.7731	0.8792
No log	4.6383	218	0.7472	0.7085	0.7472	0.8644
No log	4.6809	220	0.7281	0.7203	0.7281	0.8533
No log	4.7234	222	0.7318	0.7255	0.7318	0.8554
No log	4.7660	224	0.7542	0.7093	0.7542	0.8684
No log	4.8085	226	0.7653	0.7093	0.7653	0.8748
No log	4.8511	228	0.7486	0.7255	0.7486	0.8652
No log	4.8936	230	0.7407	0.7203	0.7407	0.8606
No log	4.9362	232	0.7479	0.7246	0.7479	0.8648
No log	4.9787	234	0.7801	0.7027	0.7801	0.8833
No log	5.0213	236	0.8356	0.6959	0.8356	0.9141
No log	5.0638	238	0.9272	0.6468	0.9272	0.9629
No log	5.1064	240	0.9387	0.6421	0.9387	0.9688
No log	5.1489	242	0.9718	0.6207	0.9718	0.9858
No log	5.1915	244	0.9840	0.6030	0.9840	0.9919
No log	5.2340	246	0.9899	0.6030	0.9899	0.9949
No log	5.2766	248	0.9566	0.6151	0.9566	0.9781
No log	5.3191	250	0.9185	0.6368	0.9185	0.9584
No log	5.3617	252	0.8608	0.6739	0.8608	0.9278
No log	5.4043	254	0.8205	0.6868	0.8205	0.9058
No log	5.4468	256	0.7915	0.6912	0.7915	0.8897
No log	5.4894	258	0.7988	0.6947	0.7988	0.8938
No log	5.5319	260	0.8614	0.6783	0.8614	0.9281
No log	5.5745	262	0.9276	0.6827	0.9276	0.9631
No log	5.6170	264	0.9184	0.6657	0.9184	0.9583
No log	5.6596	266	0.8619	0.6740	0.8619	0.9284
No log	5.7021	268	0.7895	0.6979	0.7895	0.8885
No log	5.7447	270	0.7739	0.7132	0.7739	0.8797
No log	5.7872	272	0.7706	0.7027	0.7706	0.8778
No log	5.8298	274	0.7819	0.6852	0.7819	0.8843
No log	5.8723	276	0.8121	0.6832	0.8121	0.9012
No log	5.9149	278	0.8655	0.6861	0.8655	0.9303
No log	5.9574	280	0.8763	0.6861	0.8763	0.9361
No log	6.0	282	0.8659	0.6809	0.8659	0.9305
No log	6.0426	284	0.8623	0.6791	0.8623	0.9286
No log	6.0851	286	0.8433	0.6760	0.8433	0.9183
No log	6.1277	288	0.7907	0.6824	0.7907	0.8892
No log	6.1702	290	0.7545	0.6714	0.7545	0.8686
No log	6.2128	292	0.7538	0.6915	0.7538	0.8682
No log	6.2553	294	0.7797	0.6865	0.7797	0.8830
No log	6.2979	296	0.8079	0.6941	0.8079	0.8988
No log	6.3404	298	0.8238	0.6958	0.8238	0.9076
No log	6.3830	300	0.8325	0.6899	0.8325	0.9124
No log	6.4255	302	0.8058	0.6857	0.8058	0.8977
No log	6.4681	304	0.7462	0.7203	0.7462	0.8638
No log	6.5106	306	0.7176	0.6807	0.7176	0.8471
No log	6.5532	308	0.7160	0.6627	0.7160	0.8461
No log	6.5957	310	0.7318	0.6959	0.7318	0.8555
No log	6.6383	312	0.7710	0.6832	0.7710	0.8781
No log	6.6809	314	0.8073	0.6893	0.8073	0.8985
No log	6.7234	316	0.8405	0.6886	0.8405	0.9168
No log	6.7660	318	0.8929	0.6910	0.8929	0.9449
No log	6.8085	320	0.9171	0.6857	0.9171	0.9576
No log	6.8511	322	0.9108	0.6951	0.9108	0.9543
No log	6.8936	324	0.9160	0.6951	0.9160	0.9571
No log	6.9362	326	0.9299	0.6863	0.9299	0.9643
No log	6.9787	328	0.8932	0.6767	0.8932	0.9451
No log	7.0213	330	0.8436	0.6900	0.8436	0.9185
No log	7.0638	332	0.8275	0.6900	0.8275	0.9097
No log	7.1064	334	0.8120	0.6859	0.8120	0.9011
No log	7.1489	336	0.8057	0.6947	0.8057	0.8976
No log	7.1915	338	0.8079	0.6959	0.8079	0.8988
No log	7.2340	340	0.8003	0.6959	0.8003	0.8946
No log	7.2766	342	0.7981	0.6899	0.7981	0.8934
No log	7.3191	344	0.8176	0.6825	0.8176	0.9042
No log	7.3617	346	0.8492	0.6928	0.8492	0.9215
No log	7.4043	348	0.8832	0.6928	0.8832	0.9398
No log	7.4468	350	0.8845	0.6928	0.8845	0.9405
No log	7.4894	352	0.8714	0.6839	0.8714	0.9335
No log	7.5319	354	0.8734	0.6794	0.8734	0.9346
No log	7.5745	356	0.8889	0.6794	0.8889	0.9428
No log	7.6170	358	0.9266	0.6815	0.9266	0.9626
No log	7.6596	360	0.9550	0.6524	0.9550	0.9772
No log	7.7021	362	0.9630	0.6421	0.9630	0.9813
No log	7.7447	364	0.9593	0.6220	0.9593	0.9794
No log	7.7872	366	0.9545	0.6179	0.9545	0.9770
No log	7.8298	368	0.9250	0.6347	0.9250	0.9618
No log	7.8723	370	0.9028	0.6341	0.9028	0.9501
No log	7.9149	372	0.8874	0.6695	0.8874	0.9420
No log	7.9574	374	0.8772	0.6633	0.8772	0.9366
No log	8.0	376	0.8818	0.6695	0.8818	0.9391
No log	8.0426	378	0.8825	0.6695	0.8825	0.9394
No log	8.0851	380	0.8949	0.6695	0.8949	0.9460
No log	8.1277	382	0.9037	0.6662	0.9037	0.9507
No log	8.1702	384	0.8805	0.6712	0.8805	0.9383
No log	8.2128	386	0.8594	0.6650	0.8594	0.9270
No log	8.2553	388	0.8601	0.6712	0.8601	0.9274
No log	8.2979	390	0.8690	0.6712	0.8690	0.9322
No log	8.3404	392	0.8699	0.6712	0.8699	0.9327
No log	8.3830	394	0.8681	0.6712	0.8681	0.9317
No log	8.4255	396	0.8678	0.6712	0.8678	0.9316
No log	8.4681	398	0.8653	0.6712	0.8653	0.9302
No log	8.5106	400	0.8670	0.6712	0.8670	0.9311
No log	8.5532	402	0.8580	0.6650	0.8580	0.9263
No log	8.5957	404	0.8684	0.6633	0.8684	0.9319
No log	8.6383	406	0.8857	0.6695	0.8857	0.9411
No log	8.6809	408	0.9027	0.6601	0.9027	0.9501
No log	8.7234	410	0.9058	0.6662	0.9058	0.9517
No log	8.7660	412	0.9117	0.6452	0.9117	0.9548
No log	8.8085	414	0.9178	0.6452	0.9178	0.9580
No log	8.8511	416	0.9187	0.6493	0.9187	0.9585
No log	8.8936	418	0.9200	0.6478	0.9200	0.9592
No log	8.9362	420	0.9083	0.6662	0.9083	0.9530
No log	8.9787	422	0.8950	0.6695	0.8950	0.9461
No log	9.0213	424	0.8906	0.6608	0.8906	0.9437
No log	9.0638	426	0.8880	0.6608	0.8880	0.9423
No log	9.1064	428	0.8884	0.6608	0.8884	0.9425
No log	9.1489	430	0.8869	0.6608	0.8869	0.9418
No log	9.1915	432	0.8905	0.6608	0.8905	0.9437
No log	9.2340	434	0.8871	0.6608	0.8871	0.9419
No log	9.2766	436	0.8878	0.6608	0.8878	0.9423
No log	9.3191	438	0.8817	0.6608	0.8817	0.9390
No log	9.3617	440	0.8747	0.6608	0.8747	0.9352
No log	9.4043	442	0.8755	0.6608	0.8755	0.9357
No log	9.4468	444	0.8738	0.6727	0.8738	0.9348
No log	9.4894	446	0.8696	0.6744	0.8696	0.9325
No log	9.5319	448	0.8641	0.6744	0.8641	0.9296
No log	9.5745	450	0.8617	0.6744	0.8617	0.9283
No log	9.6170	452	0.8607	0.6744	0.8607	0.9277
No log	9.6596	454	0.8615	0.6744	0.8615	0.9282
No log	9.7021	456	0.8592	0.6744	0.8592	0.9269
No log	9.7447	458	0.8581	0.6744	0.8581	0.9264
No log	9.7872	460	0.8561	0.6917	0.8561	0.9253
No log	9.8298	462	0.8547	0.6917	0.8547	0.9245
No log	9.8723	464	0.8532	0.6917	0.8532	0.9237
No log	9.9149	466	0.8526	0.6917	0.8526	0.9234
No log	9.9574	468	0.8522	0.6917	0.8522	0.9232
No log	10.0	470	0.8521	0.6917	0.8521	0.9231

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.21.0
Tokenizers 0.19.1

Task: Text Classification
Library: transformers
Type: bert
Created: Dec 8, 2024
Updated: Dec 8, 2024