text-message-analyzer-finetuned

matchten/text-message-analyzer-finetuned

text-message-analyzer-finetuned is a text classification model from matchten. Use it when you need a label for a piece of text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

1% of all-time downloads

All-time downloads

563

Public

Parameters

125M

2.5 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors499 MB · 99%

At a glance

Task: Text Classification
Library: transformers
Model type: roberta
Access: Public
Created: Nov 14, 2023
Updated: Nov 19, 2023
SHA: 93903353

Try a prompt

Base models

cardiffnlp/twitter-roberta-base-sentiment-latest

Datasets

daily_dialog

Model card

From the Hugging Face model README

text-message-analyzer-finetuned

This model is a fine-tuned version of cardiffnlp/twitter-roberta-base-sentiment-latest on the daily_dialog dataset. It achieves the following results on the evaluation set:

Loss: 0.5913
Accuracy: 0.762
F1: 0.7650
Precision: 0.7706
Recall: 0.762

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 15
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy	F1	Precision	Recall
No log	0.01	5	0.8666	0.589	0.5903	0.6104	0.589
No log	0.01	10	0.7596	0.661	0.6590	0.6603	0.661
No log	0.02	15	1.1783	0.521	0.5244	0.7242	0.521
No log	0.02	20	0.8909	0.615	0.6318	0.6910	0.615
No log	0.03	25	0.7995	0.666	0.6743	0.6918	0.666
No log	0.03	30	0.7699	0.65	0.6585	0.6935	0.65
No log	0.04	35	0.7344	0.662	0.6691	0.6857	0.662
No log	0.04	40	0.7326	0.654	0.6675	0.7036	0.654
No log	0.05	45	0.9608	0.603	0.5705	0.7211	0.603
No log	0.05	50	0.8593	0.628	0.6338	0.7262	0.628
No log	0.06	55	0.8635	0.626	0.6066	0.7400	0.626
No log	0.07	60	0.7101	0.682	0.6782	0.6911	0.682
No log	0.07	65	0.7569	0.67	0.6780	0.7067	0.67
No log	0.08	70	0.7694	0.653	0.6608	0.7271	0.653
No log	0.08	75	0.6941	0.691	0.6925	0.7202	0.691
No log	0.09	80	0.8646	0.606	0.6168	0.7450	0.606
No log	0.09	85	0.6853	0.677	0.6895	0.7369	0.677
No log	0.1	90	0.6410	0.727	0.7264	0.7272	0.727
No log	0.1	95	0.7059	0.693	0.7020	0.7410	0.693
No log	0.11	100	0.7398	0.665	0.6734	0.7441	0.665
No log	0.11	105	0.7205	0.683	0.6884	0.7243	0.683
No log	0.12	110	0.7492	0.661	0.6741	0.7410	0.661
No log	0.12	115	0.7273	0.676	0.6932	0.7388	0.676
No log	0.13	120	0.6670	0.678	0.6853	0.7079	0.678
No log	0.14	125	0.7238	0.663	0.6707	0.7348	0.663
No log	0.14	130	0.7109	0.68	0.6948	0.7333	0.68
No log	0.15	135	0.6813	0.685	0.6832	0.7324	0.685
No log	0.15	140	0.6859	0.692	0.7002	0.7304	0.692
No log	0.16	145	0.7968	0.622	0.6231	0.7268	0.622
No log	0.16	150	0.6754	0.695	0.7022	0.7212	0.695
No log	0.17	155	0.6520	0.698	0.6981	0.7296	0.698
No log	0.17	160	0.6198	0.726	0.7282	0.7334	0.726
No log	0.18	165	0.6745	0.703	0.6974	0.7346	0.703
No log	0.18	170	0.6724	0.707	0.7182	0.7486	0.707
No log	0.19	175	0.7787	0.636	0.6392	0.7409	0.636
No log	0.2	180	0.7098	0.667	0.6663	0.7338	0.667
No log	0.2	185	0.6340	0.728	0.7290	0.7340	0.728
No log	0.21	190	0.6561	0.698	0.7023	0.7229	0.698
No log	0.21	195	0.6790	0.678	0.6804	0.7318	0.678
No log	0.22	200	0.7213	0.654	0.6497	0.7337	0.654
No log	0.22	205	0.7410	0.652	0.6609	0.7242	0.652
No log	0.23	210	0.6848	0.703	0.7084	0.7332	0.703
No log	0.23	215	0.6946	0.689	0.6796	0.7291	0.689
No log	0.24	220	0.7092	0.674	0.6870	0.7311	0.674
No log	0.24	225	0.6285	0.705	0.7085	0.7295	0.705
No log	0.25	230	0.6449	0.696	0.6990	0.7166	0.696
No log	0.25	235	0.7303	0.671	0.6694	0.7366	0.671
No log	0.26	240	0.7583	0.67	0.6822	0.7399	0.67
No log	0.27	245	0.7154	0.678	0.6866	0.7443	0.678
No log	0.27	250	0.7337	0.686	0.6852	0.7369	0.686
No log	0.28	255	0.6486	0.711	0.7136	0.7362	0.711
No log	0.28	260	0.6231	0.736	0.7350	0.7410	0.736
No log	0.29	265	0.6963	0.709	0.7211	0.7532	0.709
No log	0.29	270	0.6847	0.693	0.7028	0.7403	0.693
No log	0.3	275	0.6581	0.696	0.6969	0.7464	0.696
No log	0.3	280	0.6182	0.702	0.7061	0.7187	0.702
No log	0.31	285	0.6653	0.682	0.6898	0.7144	0.682
No log	0.31	290	0.6917	0.699	0.7091	0.7372	0.699
No log	0.32	295	0.6722	0.704	0.7067	0.7285	0.704
No log	0.33	300	0.6582	0.703	0.7073	0.7238	0.703
No log	0.33	305	0.6568	0.687	0.6934	0.7146	0.687
No log	0.34	310	0.6912	0.665	0.6605	0.7292	0.665
No log	0.34	315	0.6223	0.71	0.7119	0.7311	0.71
No log	0.35	320	0.6409	0.714	0.7146	0.7244	0.714
No log	0.35	325	0.7169	0.689	0.7023	0.7385	0.689
No log	0.36	330	0.7887	0.649	0.6580	0.7435	0.649
No log	0.36	335	0.6594	0.694	0.6987	0.7111	0.694
No log	0.37	340	0.6559	0.713	0.7121	0.7137	0.713
No log	0.37	345	0.6490	0.686	0.6927	0.7076	0.686
No log	0.38	350	0.6964	0.67	0.6837	0.7424	0.67
No log	0.39	355	0.7011	0.669	0.6873	0.7460	0.669
No log	0.39	360	0.6987	0.668	0.6875	0.7409	0.668
No log	0.4	365	0.6375	0.696	0.7057	0.7340	0.696
No log	0.4	370	0.6365	0.695	0.6972	0.7270	0.695
No log	0.41	375	0.6212	0.712	0.7190	0.7488	0.712
No log	0.41	380	0.7102	0.667	0.6770	0.7532	0.667
No log	0.42	385	0.7385	0.66	0.6616	0.7498	0.66
No log	0.42	390	0.6221	0.723	0.7276	0.7533	0.723
No log	0.43	395	0.6174	0.74	0.7469	0.7651	0.74
No log	0.43	400	0.6092	0.748	0.7538	0.7644	0.748
No log	0.44	405	0.5978	0.737	0.7412	0.7483	0.737
No log	0.44	410	0.6645	0.697	0.6964	0.7402	0.697
No log	0.45	415	0.7153	0.67	0.6654	0.7372	0.67
No log	0.46	420	0.6236	0.728	0.7343	0.7560	0.728
No log	0.46	425	0.7162	0.682	0.6915	0.7441	0.682
No log	0.47	430	0.6658	0.712	0.7228	0.7530	0.712
No log	0.47	435	0.6350	0.725	0.7326	0.7535	0.725
No log	0.48	440	0.5977	0.725	0.7293	0.7378	0.725
No log	0.48	445	0.5900	0.722	0.7246	0.7312	0.722
No log	0.49	450	0.5993	0.716	0.7198	0.7327	0.716
No log	0.49	455	0.6322	0.711	0.7189	0.7450	0.711
No log	0.5	460	0.7598	0.668	0.6824	0.7507	0.668
No log	0.5	465	0.7033	0.7	0.7133	0.7620	0.7
No log	0.51	470	0.6343	0.726	0.7348	0.7525	0.726
No log	0.52	475	0.6080	0.729	0.7352	0.7507	0.729
No log	0.52	480	0.5939	0.741	0.7455	0.7539	0.741
No log	0.53	485	0.6038	0.739	0.7448	0.7560	0.739
No log	0.53	490	0.6240	0.734	0.7386	0.7566	0.734
No log	0.54	495	0.6442	0.724	0.7323	0.7560	0.724
0.7055	0.54	500	0.7067	0.71	0.7237	0.7583	0.71
0.7055	0.55	505	0.7353	0.704	0.7133	0.7484	0.704
0.7055	0.55	510	0.6534	0.733	0.7377	0.7475	0.733
0.7055	0.56	515	0.7046	0.729	0.7315	0.7533	0.729
0.7055	0.56	520	0.7140	0.711	0.7130	0.7487	0.711
0.7055	0.57	525	0.6423	0.716	0.7193	0.7443	0.716
0.7055	0.57	530	0.6074	0.733	0.7377	0.7481	0.733
0.7055	0.58	535	0.6066	0.735	0.7405	0.7513	0.735
0.7055	0.59	540	0.5945	0.732	0.7374	0.7486	0.732
0.7055	0.59	545	0.6231	0.705	0.7112	0.7439	0.705
0.7055	0.6	550	0.6108	0.737	0.7460	0.7660	0.737
0.7055	0.6	555	0.5846	0.754	0.7572	0.7675	0.754
0.7055	0.61	560	0.5965	0.748	0.7496	0.7640	0.748
0.7055	0.61	565	0.5849	0.753	0.7577	0.7687	0.753
0.7055	0.62	570	0.6037	0.723	0.7269	0.7514	0.723
0.7055	0.62	575	0.5773	0.742	0.7455	0.7598	0.742
0.7055	0.63	580	0.5661	0.751	0.7545	0.7607	0.751
0.7055	0.63	585	0.5717	0.752	0.7555	0.7626	0.752
0.7055	0.64	590	0.5905	0.762	0.7674	0.7808	0.762
0.7055	0.65	595	0.5876	0.759	0.7649	0.7773	0.759
0.7055	0.65	600	0.5651	0.77	0.7717	0.7741	0.77
0.7055	0.66	605	0.5791	0.748	0.7465	0.7502	0.748
0.7055	0.66	610	0.6135	0.721	0.7210	0.7434	0.721
0.7055	0.67	615	0.6268	0.723	0.7242	0.7523	0.723
0.7055	0.67	620	0.6211	0.71	0.7106	0.7449	0.71
0.7055	0.68	625	0.5829	0.757	0.7607	0.7742	0.757
0.7055	0.68	630	0.5718	0.765	0.7681	0.7744	0.765
0.7055	0.69	635	0.5685	0.775	0.7769	0.7830	0.775
0.7055	0.69	640	0.5731	0.752	0.7545	0.7653	0.752
0.7055	0.7	645	0.5903	0.733	0.7356	0.7570	0.733
0.7055	0.7	650	0.5973	0.73	0.7327	0.7575	0.73
0.7055	0.71	655	0.6056	0.72	0.7213	0.7535	0.72
0.7055	0.72	660	0.5617	0.763	0.7648	0.7703	0.763
0.7055	0.72	665	0.5781	0.761	0.7576	0.7688	0.761
0.7055	0.73	670	0.5993	0.745	0.7409	0.7650	0.745
0.7055	0.73	675	0.6027	0.746	0.7504	0.7675	0.746
0.7055	0.74	680	0.5825	0.751	0.7534	0.7600	0.751
0.7055	0.74	685	0.5742	0.745	0.7469	0.7513	0.745
0.7055	0.75	690	0.5907	0.731	0.7313	0.7462	0.731
0.7055	0.75	695	0.6017	0.734	0.7340	0.7555	0.734
0.7055	0.76	700	0.5767	0.746	0.7477	0.7599	0.746
0.7055	0.76	705	0.5859	0.747	0.7510	0.7676	0.747
0.7055	0.77	710	0.6001	0.747	0.7518	0.7690	0.747
0.7055	0.78	715	0.6427	0.719	0.7233	0.7541	0.719
0.7055	0.78	720	0.6600	0.72	0.7247	0.7556	0.72
0.7055	0.79	725	0.6365	0.744	0.7468	0.7640	0.744
0.7055	0.79	730	0.6089	0.754	0.7555	0.7596	0.754
0.7055	0.8	735	0.6050	0.749	0.7484	0.7494	0.749
0.7055	0.8	740	0.6120	0.745	0.7442	0.7518	0.745
0.7055	0.81	745	0.6205	0.736	0.7356	0.7490	0.736
0.7055	0.81	750	0.6174	0.737	0.7376	0.7544	0.737
0.7055	0.82	755	0.6222	0.733	0.7358	0.7585	0.733
0.7055	0.82	760	0.6216	0.737	0.7428	0.7636	0.737
0.7055	0.83	765	0.6138	0.749	0.7548	0.7691	0.749
0.7055	0.84	770	0.5977	0.76	0.7628	0.7682	0.76
0.7055	0.84	775	0.5930	0.762	0.7639	0.7671	0.762
0.7055	0.85	780	0.6002	0.762	0.7632	0.7682	0.762
0.7055	0.85	785	0.6029	0.76	0.7621	0.7676	0.76
0.7055	0.86	790	0.6068	0.751	0.7544	0.7615	0.751
0.7055	0.86	795	0.6188	0.746	0.7508	0.7615	0.746
0.7055	0.87	800	0.6398	0.725	0.7300	0.7486	0.725
0.7055	0.87	805	0.6555	0.717	0.7205	0.7461	0.717
0.7055	0.88	810	0.6550	0.726	0.7282	0.7578	0.726
0.7055	0.88	815	0.6376	0.726	0.7283	0.7474	0.726
0.7055	0.89	820	0.6115	0.741	0.7436	0.7524	0.741
0.7055	0.89	825	0.6048	0.756	0.7583	0.7638	0.756
0.7055	0.9	830	0.6039	0.753	0.7548	0.7591	0.753
0.7055	0.91	835	0.6018	0.754	0.7559	0.7605	0.754
0.7055	0.91	840	0.5967	0.757	0.7597	0.7653	0.757
0.7055	0.92	845	0.5937	0.766	0.7687	0.7738	0.766
0.7055	0.92	850	0.5945	0.766	0.7689	0.7740	0.766
0.7055	0.93	855	0.5951	0.764	0.7669	0.7722	0.764
0.7055	0.93	860	0.5953	0.761	0.7640	0.7699	0.761
0.7055	0.94	865	0.5977	0.762	0.7651	0.7726	0.762
0.7055	0.94	870	0.5969	0.763	0.7659	0.7733	0.763
0.7055	0.95	875	0.5957	0.764	0.7667	0.7740	0.764
0.7055	0.95	880	0.5927	0.762	0.7650	0.7717	0.762
0.7055	0.96	885	0.5916	0.763	0.7660	0.7715	0.763
0.7055	0.97	890	0.5935	0.762	0.7654	0.7717	0.762
0.7055	0.97	895	0.5934	0.759	0.7625	0.7689	0.759
0.7055	0.98	900	0.5919	0.763	0.7660	0.7715	0.763
0.7055	0.98	905	0.5913	0.762	0.7650	0.7705	0.762
0.7055	0.99	910	0.5916	0.764	0.7671	0.7726	0.764
0.7055	0.99	915	0.5916	0.762	0.7650	0.7706	0.762
0.7055	1.0	920	0.5913	0.762	0.7650	0.7706	0.762

Framework versions

Transformers 4.35.2
Pytorch 2.1.0+cu118
Datasets 2.15.0
Tokenizers 0.15.0

Task: Text Classification
Library: transformers
Type: roberta
Created: Nov 14, 2023
Updated: Nov 19, 2023