custom_gpt2_frames_text_continue

Ashraf-kasem/custom_gpt2_frames_text_continue

custom_gpt2_frames_text_continue is a text generation model from Ashraf-kasem. Use it when you need the model to write or continue text. It is set up for transformers. The card lists the license as mit.

probably proofread and complete it, then remove this comment. --

Downloads · 30 days

6% of all-time downloads

All-time downloads

363

Public

Repo size

147 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.h5749 MB · 49%

At a glance

Task: Text Generation
Library: transformers
License: mit
Model type: gpt2
Access: Public
Created: Jan 25, 2023
Updated: Jan 28, 2023
SHA: 3f3dcd2a

Try a prompt

Model card

From the Hugging Face model README

Ashraf-kasem/custom_gpt2_frames_text_continue

This model is a fine-tuned version of Ashraf-kasem/custom_gpt2_frames_text_continue on an unknown dataset. It achieves the following results on the evaluation set:

Train Loss: 0.6337
Validation Loss: 2.3028
Epoch: 99

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

optimizer: {'name': 'Adam', 'learning_rate': {'class_name': 'LinearWarmup', 'config': {'after_warmup_lr_sched': {'initial_learning_rate': 5e-05, 'decay_steps': 628900, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}, 'warmup_steps': 125780, 'warmup_learning_rate': 0, 'name': None}}, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False}
training_precision: mixed_float16

Training results

Train Loss	Validation Loss	Epoch
1.0060	2.0768	0
1.0147	2.0771	1
1.0238	2.0821	2
1.0331	2.0851	3
1.0422	2.0870	4
1.0525	2.0945	5
1.0618	2.1005	6
1.0718	2.1014	7
1.0823	2.1056	8
1.0921	2.1099	9
1.1028	2.1106	10
1.1127	2.1127	11
1.1230	2.1183	12
1.1329	2.1207	13
1.1423	2.1270	14
1.1521	2.1234	15
1.1614	2.1283	16
1.1700	2.1236	17
1.1784	2.1320	18
1.1864	2.1359	19
1.1873	2.1272	20
1.1766	2.1250	21
1.1652	2.1260	22
1.1537	2.1224	23
1.1415	2.1278	24
1.1296	2.1254	25
1.1178	2.1213	26
1.1059	2.1301	27
1.0950	2.1253	28
1.0838	2.1264	29
1.0729	2.1273	30
1.0625	2.1355	31
1.0519	2.1345	32
1.0414	2.1364	33
1.0317	2.1324	34
1.0217	2.1410	35
1.0126	2.1428	36
1.0027	2.1427	37
0.9936	2.1494	38
0.9846	2.1502	39
0.9752	2.1490	40
0.9665	2.1501	41
0.9582	2.1552	42
0.9497	2.1533	43
0.9411	2.1621	44
0.9331	2.1618	45
0.9248	2.1655	46
0.9172	2.1755	47
0.9093	2.1759	48
0.9014	2.1751	49
0.8942	2.1813	50
0.8867	2.1831	51
0.8795	2.1856	52
0.8723	2.1909	53
0.8651	2.1950	54
0.8581	2.1955	55
0.8511	2.2007	56
0.8444	2.2002	57
0.8380	2.2078	58
0.8312	2.2077	59
0.8246	2.2161	60
0.8186	2.2103	61
0.8120	2.2180	62
0.8053	2.2202	63
0.7994	2.2232	64
0.7934	2.2290	65
0.7872	2.2301	66
0.7816	2.2327	67
0.7757	2.2369	68
0.7698	2.2408	69
0.7640	2.2439	70
0.7582	2.2451	71
0.7528	2.2505	72
0.7475	2.2524	73
0.7420	2.2520	74
0.7366	2.2561	75
0.7313	2.2616	76
0.7260	2.2628	77
0.7211	2.2654	78
0.7158	2.2701	79
0.7107	2.2704	80
0.7061	2.2743	81
0.7008	2.2749	82
0.6962	2.2769	83
0.6916	2.2813	84
0.6869	2.2838	85
0.6823	2.2853	86
0.6780	2.2867	87
0.6737	2.2883	88
0.6691	2.2921	89
0.6651	2.2931	90
0.6608	2.2946	91
0.6568	2.2957	92
0.6533	2.2984	93
0.6494	2.2981	94
0.6459	2.2994	95
0.6425	2.3006	96
0.6395	2.3019	97
0.6363	2.3026	98
0.6337	2.3028	99

Framework versions

Transformers 4.25.1
TensorFlow 2.9.0
Datasets 2.8.0
Tokenizers 0.13.2

Task: Text Generation
Library: transformers
Type: gpt2
License: mit
Created: Jan 25, 2023
Updated: Jan 28, 2023