ASAP_nosemantic_FineTuningBERT_AugV12_k5_task1_organization_k5_k5_fold4

genki10/ASAP_nosemantic_FineTuningBERT_AugV12_k5_task1_organization_k5_k5_fold4

ASAP_nosemantic_FineTuningBERT_AugV12_k5_task1_organization_k5_k5_fold4 is a text classification model from genki10. Use it when you need a label for a piece of text. It is set up for transformers. The card lists the license as apache-2.0.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

3% of all-time downloads

All-time downloads

139

Public

Repo size

57.4 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin876 MB · 100%

At a glance

Task: Text Classification
Library: transformers
License: apache-2.0
Model type: bert
Access: Public
Created: Mar 7, 2025
Updated: Mar 7, 2025
SHA: 312c06ea

Try a prompt

Base models

Model card

From the Hugging Face model README

ASAP_nosemantic_FineTuningBERT_AugV12_k5_task1_organization_k5_k5_fold4

This model is a fine-tuned version of bert-base-uncased on the None dataset. It achieves the following results on the evaluation set:

Loss: 0.8909
Qwk: 0.5177
Mse: 0.8909
Rmse: 0.9439

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	1.0	3	9.3995	0.0	9.3995	3.0659
No log	2.0	6	8.1726	0.0	8.1726	2.8588
No log	3.0	9	6.6002	0.0	6.6002	2.5691
No log	4.0	12	4.9292	0.0079	4.9292	2.2202
No log	5.0	15	3.4735	0.0040	3.4735	1.8637
No log	6.0	18	2.4385	0.0785	2.4385	1.5616
No log	7.0	21	1.7734	0.0710	1.7734	1.3317
No log	8.0	24	1.1758	0.0316	1.1758	1.0843
No log	9.0	27	0.9586	0.0275	0.9586	0.9791
No log	10.0	30	0.7992	0.2928	0.7992	0.8940
No log	11.0	33	0.7909	0.3315	0.7909	0.8893
No log	12.0	36	1.0064	0.0213	1.0064	1.0032
No log	13.0	39	0.8587	0.1078	0.8587	0.9267
No log	14.0	42	0.6652	0.4458	0.6652	0.8156
No log	15.0	45	0.7820	0.4705	0.7820	0.8843
No log	16.0	48	0.9174	0.4213	0.9174	0.9578
No log	17.0	51	0.8728	0.4818	0.8728	0.9342
No log	18.0	54	1.1635	0.4117	1.1635	1.0787
No log	19.0	57	0.9477	0.4959	0.9477	0.9735
No log	20.0	60	1.3732	0.3644	1.3732	1.1718
No log	21.0	63	0.9884	0.5058	0.9884	0.9942
No log	22.0	66	1.6549	0.3276	1.6549	1.2864
No log	23.0	69	1.3858	0.3944	1.3858	1.1772
No log	24.0	72	0.9907	0.5187	0.9907	0.9953
No log	25.0	75	1.2974	0.3970	1.2974	1.1391
No log	26.0	78	1.0573	0.5012	1.0573	1.0283
No log	27.0	81	1.2919	0.4030	1.2919	1.1366
No log	28.0	84	1.0476	0.4788	1.0476	1.0235
No log	29.0	87	1.1094	0.4462	1.1094	1.0533
No log	30.0	90	1.0103	0.5120	1.0103	1.0051
No log	31.0	93	1.3613	0.3723	1.3613	1.1668
No log	32.0	96	1.0346	0.4835	1.0346	1.0172
No log	33.0	99	1.1337	0.4417	1.1337	1.0648
No log	34.0	102	1.0439	0.4661	1.0439	1.0217
No log	35.0	105	0.9742	0.5137	0.9742	0.9870
No log	36.0	108	1.1339	0.4295	1.1339	1.0648
No log	37.0	111	0.9578	0.5425	0.9578	0.9787
No log	38.0	114	1.0447	0.4577	1.0447	1.0221
No log	39.0	117	0.9351	0.5532	0.9351	0.9670
No log	40.0	120	1.1112	0.4143	1.1112	1.0541
No log	41.0	123	0.9397	0.5053	0.9397	0.9694
No log	42.0	126	0.9883	0.4793	0.9883	0.9941
No log	43.0	129	1.0158	0.4661	1.0158	1.0079
No log	44.0	132	0.9288	0.5208	0.9288	0.9637
No log	45.0	135	0.9567	0.5200	0.9567	0.9781
No log	46.0	138	1.0742	0.4581	1.0742	1.0364
No log	47.0	141	0.9314	0.5198	0.9314	0.9651
No log	48.0	144	1.0068	0.4768	1.0068	1.0034
No log	49.0	147	0.9147	0.5166	0.9147	0.9564
No log	50.0	150	1.0591	0.4503	1.0591	1.0291
No log	51.0	153	0.8874	0.5423	0.8874	0.9420
No log	52.0	156	0.8847	0.5340	0.8847	0.9406
No log	53.0	159	1.1092	0.4186	1.1092	1.0532
No log	54.0	162	0.9465	0.4804	0.9465	0.9729
No log	55.0	165	0.9663	0.5265	0.9663	0.9830
No log	56.0	168	0.9953	0.4685	0.9953	0.9976
No log	57.0	171	1.0283	0.4590	1.0283	1.0141
No log	58.0	174	0.9080	0.5183	0.9080	0.9529
No log	59.0	177	0.8909	0.5177	0.8909	0.9439

Framework versions

Transformers 4.47.0
Pytorch 2.5.1+cu121
Datasets 3.3.1
Tokenizers 0.21.0

Task: Text Classification
Library: transformers
Type: bert
License: apache-2.0
Created: Mar 7, 2025
Updated: Mar 7, 2025