11jul-filtered_tweets

DouglasPontes/11jul-filtered_tweets

11jul-filtered_tweets is a fill-mask model from DouglasPontes. Use it when you need the model to fill a missing word. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

4% of all-time downloads

All-time downloads

148

Public

Repo size

37.9 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin499 MB · 99%

At a glance

Task: Fill-Mask
Library: transformers
Model type: roberta
Access: Public
Created: Jul 11, 2023
Updated: Jul 15, 2023
SHA: 7b1dfe2c

Try a prompt

Model card

From the Hugging Face model README

11jul-filtered_tweets

This model is a fine-tuned version of ./model_tweets_2019 on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 2.5545

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 4.1e-07
train_batch_size: 16
eval_batch_size: 16
seed: 42
optimizer: Adam with betas=(0.9,0.98) and epsilon=1e-08
lr_scheduler_type: linear
training_steps: 2400000

Training results

Training Loss	Epoch	Step	Validation Loss
No log	0.25	8000	2.9512
3.1757	0.5	16000	2.8425
3.1757	0.75	24000	2.7666
2.924	1.0	32000	2.7425
2.924	1.25	40000	2.7106
2.8592	1.5	48000	2.6844
2.8592	1.75	56000	2.7093
2.83	2.0	64000	2.6717
2.83	2.25	72000	2.6630
2.8028	2.5	80000	2.6702
2.8028	2.75	88000	2.6711
2.7946	3.0	96000	2.6588
2.7946	3.26	104000	2.6297
2.7786	3.51	112000	2.6587
2.7786	3.76	120000	2.6469
2.7714	4.01	128000	2.6386
2.7714	4.26	136000	2.6694
2.7638	4.51	144000	2.6297
2.7638	4.76	152000	2.6502
2.7644	5.01	160000	2.6578
2.7644	5.26	168000	2.6088
2.7531	5.51	176000	2.6317
2.7531	5.76	184000	2.6299
2.759	6.01	192000	2.6422
2.759	6.26	200000	2.6136
2.7496	6.51	208000	2.6363
2.7496	6.76	216000	2.6274
2.7529	7.01	224000	2.6160
2.7529	7.26	232000	2.6298
2.7456	7.51	240000	2.6208
2.7456	7.76	248000	2.6095
2.7404	8.01	256000	2.6069
2.7404	8.26	264000	2.5831
2.7355	8.51	272000	2.6136
2.7355	8.76	280000	2.6075
2.7345	9.01	288000	2.5976
2.7345	9.26	296000	2.6100
2.7324	9.52	304000	2.6142
2.7324	9.77	312000	2.6072
2.7308	10.02	320000	2.6105
2.7308	10.27	328000	2.6167
2.7272	10.52	336000	2.5891
2.7272	10.77	344000	2.6084
2.736	11.02	352000	2.6131
2.736	11.27	360000	2.5864
2.7318	11.52	368000	2.6184
2.7318	11.77	376000	2.5971
2.7345	12.02	384000	2.5649
2.7345	12.27	392000	2.5936
2.7249	12.52	400000	2.6101
2.7249	12.77	408000	2.5798
2.7351	13.02	416000	2.5903
2.7351	13.27	424000	2.6260
2.7255	13.52	432000	2.6194
2.7255	13.77	440000	2.6140
2.7249	14.02	448000	2.5795
2.7249	14.27	456000	2.5961
2.7217	14.52	464000	2.5972
2.7217	14.77	472000	2.5877
2.7246	15.02	480000	2.5760
2.7246	15.27	488000	2.5926
2.7223	15.52	496000	2.6017
2.7223	15.78	504000	2.5969
2.7261	16.03	512000	2.5919
2.7261	16.28	520000	2.6044
2.7237	16.53	528000	2.6042
2.7237	16.78	536000	2.5812
2.7234	17.03	544000	2.5887
2.7234	17.28	552000	2.6220
2.7249	17.53	560000	2.5997
2.7249	17.78	568000	2.5860
2.7237	18.03	576000	2.6072
2.7237	18.28	584000	2.5817
2.7246	18.53	592000	2.5931
2.7246	18.78	600000	2.5815
2.7233	19.03	608000	2.5723
2.7233	19.28	616000	2.5887
2.7142	19.53	624000	2.5862
2.7142	19.78	632000	2.6196
2.7169	20.03	640000	2.5906
2.7169	20.28	648000	2.5897
2.7189	20.53	656000	2.6032
2.7189	20.78	664000	2.6001
2.7193	21.03	672000	2.5951
2.7193	21.28	680000	2.5839
2.7176	21.53	688000	2.5792
2.7176	21.78	696000	2.5972
2.7206	22.04	704000	2.5993
2.7206	22.29	712000	2.5966
2.7118	22.54	720000	2.5655
2.7118	22.79	728000	2.5832
2.7185	23.04	736000	2.5695
2.7185	23.29	744000	2.5662
2.7162	23.54	752000	2.5866
2.7162	23.79	760000	2.5729
2.714	24.04	768000	2.5876
2.714	24.29	776000	2.5816
2.7071	24.54	784000	2.6026
2.7071	24.79	792000	2.5834
2.7154	25.04	800000	2.5872
2.7154	25.29	808000	2.5804
2.7121	25.54	816000	2.6039
2.7121	25.79	824000	2.5803
2.7061	26.04	832000	2.5850
2.7061	26.29	840000	2.5766
2.7065	26.54	848000	2.5914
2.7065	26.79	856000	2.5810
2.7149	27.04	864000	2.5884
2.7149	27.29	872000	2.5676
2.7076	27.54	880000	2.5884
2.7076	27.79	888000	2.5598
2.7092	28.04	896000	2.5741
2.7092	28.3	904000	2.5898
2.7033	28.55	912000	2.5956
2.7033	28.8	920000	2.5792
2.7075	29.05	928000	2.5805
2.7075	29.3	936000	2.5790
2.7011	29.55	944000	2.5754
2.7011	29.8	952000	2.5768
2.7053	30.05	960000	2.5722
2.7053	30.3	968000	2.5683
2.6988	30.55	976000	2.5965
2.6988	30.8	984000	2.6246
2.7089	31.05	992000	2.6169
2.7089	31.3	1000000	2.5910
2.716	31.55	1008000	2.5767
2.716	31.8	1016000	2.5883
2.7103	32.05	1024000	2.5601
2.7103	32.3	1032000	2.5739
2.706	32.55	1040000	2.5870
2.706	32.8	1048000	2.5976
2.7088	33.05	1056000	2.5769
2.7088	33.3	1064000	2.5688
2.703	33.55	1072000	2.5604
2.703	33.8	1080000	2.5719
2.712	34.05	1088000	2.5797
2.712	34.3	1096000	2.5561
2.7008	34.56	1104000	2.5654
2.7008	34.81	1112000	2.5802
2.7052	35.06	1120000	2.5729
2.7052	35.31	1128000	2.5810
2.7031	35.56	1136000	2.5681
2.7031	35.81	1144000	2.5781
2.702	36.06	1152000	2.5811
2.702	36.31	1160000	2.5827
2.6986	36.56	1168000	2.5716
2.6986	36.81	1176000	2.5553
2.6985	37.06	1184000	2.5746
2.6985	37.31	1192000	2.5655
2.7042	37.56	1200000	2.5836
2.7042	37.81	1208000	2.5898
2.7093	38.06	1216000	2.5779
2.7093	38.31	1224000	2.5912
2.7108	38.56	1232000	2.5720
2.7108	38.81	1240000	2.5728
2.7023	39.06	1248000	2.5882
2.7023	39.31	1256000	2.5858
2.7025	39.56	1264000	2.5806
2.7025	39.81	1272000	2.5723
2.6993	40.06	1280000	2.5607
2.6993	40.31	1288000	2.5715
2.7042	40.56	1296000	2.5881
2.7042	40.82	1304000	2.5734
2.7006	41.07	1312000	2.5711
2.7006	41.32	1320000	2.5686
2.691	41.57	1328000	2.5655
2.691	41.82	1336000	2.5519
2.7039	42.07	1344000	2.5942
2.7039	42.32	1352000	2.5920
2.6979	42.57	1360000	2.5711
2.6979	42.82	1368000	2.5686
2.7027	43.07	1376000	2.5708
2.7027	43.32	1384000	2.5619
2.6982	43.57	1392000	2.5836
2.6982	43.82	1400000	2.5781
2.6998	44.07	1408000	2.5691
2.6998	44.32	1416000	2.5735
2.6933	44.57	1424000	2.5383
2.6933	44.82	1432000	2.5936
2.7026	45.07	1440000	2.5486
2.7026	45.32	1448000	2.5586
2.6928	45.57	1456000	2.5715
2.6928	45.82	1464000	2.5450
2.699	46.07	1472000	2.5726
2.699	46.32	1480000	2.5677
2.7	46.57	1488000	2.5615
2.7	46.82	1496000	2.5721
2.7014	47.08	1504000	2.5562
2.7014	47.33	1512000	2.5676
2.6924	47.58	1520000	2.5670
2.6924	47.83	1528000	2.5643
2.6918	48.08	1536000	2.5836
2.6918	48.33	1544000	2.5420
2.7047	48.58	1552000	2.5471
2.7047	48.83	1560000	2.5655
2.6875	49.08	1568000	2.5670
2.6875	49.33	1576000	2.5551
2.6966	49.58	1584000	2.5814
2.6966	49.83	1592000	2.5690
2.7004	50.08	1600000	2.5666
2.7004	50.33	1608000	2.5571
2.6978	50.58	1616000	2.5620
2.6978	50.83	1624000	2.5749
2.6921	51.08	1632000	2.5810
2.6921	51.33	1640000	2.5710
2.6958	51.58	1648000	2.5627
2.6958	51.83	1656000	2.5729
2.6909	52.08	1664000	2.5785
2.6909	52.33	1672000	2.5725
2.6906	52.58	1680000	2.5745
2.6906	52.83	1688000	2.5708
2.6886	53.08	1696000	2.5379
2.6886	53.34	1704000	2.5692
2.6931	53.59	1712000	2.5716
2.6931	53.84	1720000	2.5474
2.6976	54.09	1728000	2.5843
2.6976	54.34	1736000	2.5615
2.7044	54.59	1744000	2.5678
2.7044	54.84	1752000	2.5513
2.7076	55.09	1760000	2.5642
2.7076	55.34	1768000	2.5533
2.6957	55.59	1776000	2.5803
2.6957	55.84	1784000	2.5523
2.6911	56.09	1792000	2.5769
2.6911	56.34	1800000	2.5510
2.6949	56.59	1808000	2.5712
2.6949	56.84	1816000	2.5696
2.6935	57.09	1824000	2.5776
2.6935	57.34	1832000	2.5495
2.6924	57.59	1840000	2.5555
2.6924	57.84	1848000	2.5893
2.6992	58.09	1856000	2.5474
2.6992	58.34	1864000	2.5591
2.6938	58.59	1872000	2.5641
2.6938	58.84	1880000	2.5716
2.6918	59.09	1888000	2.5481
2.6918	59.34	1896000	2.5384
2.6927	59.59	1904000	2.5577
2.6927	59.85	1912000	2.5693
2.6874	60.1	1920000	2.5704
2.6874	60.35	1928000	2.5680
2.6915	60.6	1936000	2.5578
2.6915	60.85	1944000	2.5540
2.6942	61.1	1952000	2.5527
2.6942	61.35	1960000	2.5956
2.7001	61.6	1968000	2.5667
2.7001	61.85	1976000	2.5741
2.692	62.1	1984000	2.5789
2.692	62.35	1992000	2.5476
2.6954	62.6	2000000	2.5700
2.6954	62.85	2008000	2.5605
2.6891	63.1	2016000	2.5873
2.6891	63.35	2024000	2.5622
2.6903	63.6	2032000	2.5888
2.6903	63.85	2040000	2.5678
2.6911	64.1	2048000	2.5558
2.6911	64.35	2056000	2.5632
2.6921	64.6	2064000	2.5564
2.6921	64.85	2072000	2.5399
2.6842	65.1	2080000	2.5599
2.6842	65.35	2088000	2.5642
2.6961	65.6	2096000	2.5573
2.6961	65.85	2104000	2.5605
2.6897	66.11	2112000	2.5627
2.6897	66.36	2120000	2.5740
2.6929	66.61	2128000	2.5796
2.6929	66.86	2136000	2.5580
2.699	67.11	2144000	2.5589
2.699	67.36	2152000	2.5618
2.6923	67.61	2160000	2.5688
2.6923	67.86	2168000	2.5876
2.6971	68.11	2176000	2.5621
2.6971	68.36	2184000	2.5822
2.6879	68.61	2192000	2.5695
2.6879	68.86	2200000	2.5471
2.694	69.11	2208000	2.5567
2.694	69.36	2216000	2.5659
2.6924	69.61	2224000	2.5781
2.6924	69.86	2232000	2.5597
2.6904	70.11	2240000	2.5779
2.6904	70.36	2248000	2.5693
2.6975	70.61	2256000	2.5734
2.6975	70.86	2264000	2.5612
2.6945	71.11	2272000	2.5453
2.6945	71.36	2280000	2.5925
2.6922	71.61	2288000	2.5666
2.6922	71.86	2296000	2.5671
2.6906	72.11	2304000	2.5575
2.6906	72.37	2312000	2.5581
2.6993	72.62	2320000	2.5700
2.6993	72.87	2328000	2.5819
2.7053	73.12	2336000	2.5811
2.7053	73.37	2344000	2.5717
2.6952	73.62	2352000	2.5754
2.6952	73.87	2360000	2.5699
2.6936	74.12	2368000	2.5752
2.6936	74.37	2376000	2.5775
2.6962	74.62	2384000	2.5843
2.6962	74.87	2392000	2.5677
2.6894	75.12	2400000	2.5784

Framework versions

Transformers 4.30.2
Pytorch 2.0.1+cu117
Datasets 2.13.1
Tokenizers 0.13.3

Task: Fill-Mask
Library: transformers
Type: roberta
Created: Jul 11, 2023
Updated: Jul 15, 2023