nekta_ai_v1

webstels/nekta_ai_v1

nekta_ai_v1 is a text generation model from webstels. Use it when you need the model to write or continue text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

13% of all-time downloads

All-time downloads

Public

Repo size

8 GB

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.bin501 MB · 99%

At a glance

Task: Text Generation
Library: transformers
Model type: gpt2
Access: Public
Created: Jun 15, 2023
Updated: Jun 15, 2023
SHA: 6900ca32

Try a prompt

Model card

From the Hugging Face model README

nekta_ai_v1

This model is a fine-tuned version of webstels/nekta_ai_v1 on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 0.0032

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 2e-05
train_batch_size: 8
eval_batch_size: 8
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
num_epochs: 50

Training results

Training Loss	Epoch	Step	Validation Loss
No log	1.0	33	0.0113
No log	2.0	66	0.0113
No log	3.0	99	0.0092
No log	4.0	132	0.0097
No log	5.0	165	0.0087
No log	6.0	198	0.0104
No log	7.0	231	0.0077
No log	8.0	264	0.0091
No log	9.0	297	0.0073
No log	10.0	330	0.0106
No log	11.0	363	0.0093
No log	12.0	396	0.0071
No log	13.0	429	0.0056
No log	14.0	462	0.0086
No log	15.0	495	0.0065
0.0293	16.0	528	0.0053
0.0293	17.0	561	0.0051
0.0293	18.0	594	0.0047
0.0293	19.0	627	0.0064
0.0293	20.0	660	0.0067
0.0293	21.0	693	0.0050
0.0293	22.0	726	0.0039
0.0293	23.0	759	0.0044
0.0293	24.0	792	0.0045
0.0293	25.0	825	0.0042
0.0293	26.0	858	0.0038
0.0293	27.0	891	0.0043
0.0293	28.0	924	0.0046
0.0293	29.0	957	0.0040
0.0293	30.0	990	0.0043
0.0203	31.0	1023	0.0039
0.0203	32.0	1056	0.0037
0.0203	33.0	1089	0.0039
0.0203	34.0	1122	0.0034
0.0203	35.0	1155	0.0032
0.0203	36.0	1188	0.0031
0.0203	37.0	1221	0.0033
0.0203	38.0	1254	0.0037
0.0203	39.0	1287	0.0035
0.0203	40.0	1320	0.0038
0.0203	41.0	1353	0.0035
0.0203	42.0	1386	0.0034
0.0203	43.0	1419	0.0036
0.0203	44.0	1452	0.0037
0.0203	45.0	1485	0.0033
0.0208	46.0	1518	0.0032
0.0208	47.0	1551	0.0032
0.0208	48.0	1584	0.0031
0.0208	49.0	1617	0.0033
0.0208	50.0	1650	0.0032

Framework versions

Transformers 4.30.2
Pytorch 2.0.1+cu118
Tokenizers 0.13.3

Task: Text Generation
Library: transformers
Type: gpt2
Created: Jun 15, 2023
Updated: Jun 15, 2023