childes-segmentation-2M-gpt2_lm-model

phonemetransformers/childes-segmentation-2M-gpt2_lm-model

childes-segmentation-2M-gpt2_lm-model is a text generation model from phonemetransformers. Use it when you need the model to write or continue text. It is set up for transformers.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

12% of all-time downloads

All-time downloads

733

Public

Parameters

4.8M

2.1 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors19.3 MB · 100%

At a glance

Task: Text Generation
Library: transformers
Model type: gpt2
Access: Public
Created: Feb 25, 2025
Updated: Feb 25, 2025
SHA: 51af82fe

Try a prompt

Model card

From the Hugging Face model README

childes-segmentation-2M-gpt2_lm-model

This model is a fine-tuned version of on an unknown dataset. It achieves the following results on the evaluation set:

Loss: 1.7887
Model Preparation Time: 0.0013
Perplexity: 5.9818
Bpc: 2.5806
Spike Seg Type Fscore Entropy: 0.5138
Spike Seg Boundary Fscore Entropy: 0.7818
Absolute Seg Type Fscore Entropy: 0.4410
Absolute Seg Boundary Fscore Entropy: 0.7237
Spike Seg Type Fscore Increase in entropy: 0.5136
Spike Seg Boundary Fscore Increase in entropy: 0.7931
Absolute Seg Type Fscore Increase in entropy: 0.5396
Absolute Seg Boundary Fscore Increase in entropy: 0.8140
Spike Seg Type Fscore Loss: 0.3578
Spike Seg Boundary Fscore Loss: 0.6452
Absolute Seg Type Fscore Loss: 0.3283
Absolute Seg Boundary Fscore Loss: 0.6480
Spike Seg Type Fscore Increase in loss: 0.4261
Spike Seg Boundary Fscore Increase in loss: 0.7088
Absolute Seg Type Fscore Increase in loss: 0.4253
Absolute Seg Boundary Fscore Increase in loss: 0.7067
Spike Seg Type Fscore Rank: 0.4242
Spike Seg Boundary Fscore Rank: 0.6919
Absolute Seg Type Fscore Rank: 0.3555
Absolute Seg Boundary Fscore Rank: 0.6386
Spike Seg Type Fscore Increase in rank: 0.4777
Spike Seg Boundary Fscore Increase in rank: 0.7384
Absolute Seg Type Fscore Increase in rank: 0.4718
Absolute Seg Boundary Fscore Increase in rank: 0.7186
Spike Seg Type Fscore Boundary prediction: 0.5560
Spike Seg Boundary Fscore Boundary prediction: 0.8304
Absolute Seg Type Fscore Boundary prediction: 0.3553
Absolute Seg Boundary Fscore Boundary prediction: 0.8616
Spike Seg Type Fscore Increase in boundary prediction: 0.5587
Spike Seg Boundary Fscore Increase in boundary prediction: 0.8313
Absolute Seg Type Fscore Increase in boundary prediction: 0.6308
Absolute Seg Boundary Fscore Increase in boundary prediction: 0.8657
Spike Seg Type Fscore Majority vote cutoff: 0.5793
Spike Seg Type Fscore Majority vote spike: 0.4985
Absolute Seg Type Fscore Majority vote cutoff: 0.5868
Absolute Seg Type Fscore Majority vote spike: 0.5687
Spike Seg Boundary Fscore Majority vote cutoff: 0.8595
Spike Seg Boundary Fscore Majority vote spike: 0.8003
Absolute Seg Boundary Fscore Majority vote cutoff: 0.8277
Absolute Seg Boundary Fscore Majority vote spike: 0.8095

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 0.001
train_batch_size: 32
eval_batch_size: 32
seed: 42
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 60000
training_steps: 200000

Training results

Training Loss	Epoch	Step	Validation Loss	Model Preparation Time	Perplexity	Bpc	Spike Seg Type Fscore Entropy	Spike Seg Boundary Fscore Entropy	Absolute Seg Type Fscore Entropy	Absolute Seg Boundary Fscore Entropy	Spike Seg Type Fscore Increase in entropy	Spike Seg Boundary Fscore Increase in entropy	Absolute Seg Type Fscore Increase in entropy	Absolute Seg Boundary Fscore Increase in entropy	Spike Seg Type Fscore Loss	Spike Seg Boundary Fscore Loss	Absolute Seg Type Fscore Loss	Absolute Seg Boundary Fscore Loss	Spike Seg Type Fscore Increase in loss	Spike Seg Boundary Fscore Increase in loss	Absolute Seg Type Fscore Increase in loss	Absolute Seg Boundary Fscore Increase in loss	Spike Seg Type Fscore Rank	Spike Seg Boundary Fscore Rank	Absolute Seg Type Fscore Rank	Absolute Seg Boundary Fscore Rank	Spike Seg Type Fscore Increase in rank	Spike Seg Boundary Fscore Increase in rank	Absolute Seg Type Fscore Increase in rank	Absolute Seg Boundary Fscore Increase in rank	Spike Seg Type Fscore Boundary prediction	Spike Seg Boundary Fscore Boundary prediction	Absolute Seg Type Fscore Boundary prediction	Absolute Seg Boundary Fscore Boundary prediction	Spike Seg Type Fscore Increase in boundary prediction	Spike Seg Boundary Fscore Increase in boundary prediction	Absolute Seg Type Fscore Increase in boundary prediction	Absolute Seg Boundary Fscore Increase in boundary prediction	Spike Seg Type Fscore Majority vote cutoff	Spike Seg Type Fscore Majority vote spike	Absolute Seg Type Fscore Majority vote cutoff	Absolute Seg Type Fscore Majority vote spike	Spike Seg Boundary Fscore Majority vote cutoff	Spike Seg Boundary Fscore Majority vote spike	Absolute Seg Boundary Fscore Majority vote cutoff	Absolute Seg Boundary Fscore Majority vote spike
1.4437	45.2489	20000	1.6027	0.0013	4.9662	2.3121	0.5222	0.7967	0.4734	0.7426	0.5088	0.8028	0.5468	0.8084	0.3734	0.6720	0.3357	0.6593	0.4442	0.7423	0.4636	0.7486	0.4468	0.7109	0.2970	0.6529	0.5085	0.7618	0.4843	0.7453	0.5485	0.8276	0.4279	0.5326	0.5498	0.8286	0.6091	0.8514	0.6262	0.5191	0.6402	0.6145	0.8569	0.8099	0.8402	0.8323
1.3069	90.4977	40000	1.5824	0.0013	4.8667	2.2830	0.5272	0.8030	0.4869	0.7454	0.5087	0.7990	0.5520	0.8099	0.3583	0.6651	0.3211	0.6639	0.4417	0.7371	0.4561	0.7341	0.4471	0.7016	0.3603	0.6368	0.4978	0.7542	0.4957	0.7357	0.5546	0.8294	0.5964	0.8654	0.5496	0.8272	0.6415	0.4713	0.6320	0.5005	0.6726	0.5975	0.8503	0.8091	0.8252	0.8249
1.241	135.7466	60000	1.5860	0.0013	4.8842	2.2881	0.5224	0.7988	0.4597	0.7393	0.5135	0.7996	0.5468	0.8122	0.3905	0.6802	0.3248	0.6578	0.4534	0.7416	0.4420	0.7552	0.4527	0.7013	0.3306	0.6380	0.4987	0.7454	0.5	0.7350	0.5494	0.8287	0.5133	0.7343	0.5428	0.8291	0.6397	0.8721	0.6234	0.5020	0.6345	0.5903	0.8616	0.8121	0.8464	0.824
1.1606	180.9955	80000	1.6088	0.0013	4.9967	2.3210	0.5351	0.7995	0.4751	0.7338	0.5313	0.8058	0.5425	0.8176	0.3726	0.6618	0.3236	0.6588	0.4298	0.7279	0.4344	0.7440	0.4253	0.6939	0.3324	0.6301	0.5004	0.7431	0.4742	0.7210	0.5542	0.8344	0.4634	0.8721	0.5455	0.8357	0.6327	0.8731	0.6116	0.5219	0.6318	0.5906	0.8630	0.8130	0.8550	0.8218
1.1047	226.2443	100000	1.6528	0.0013	5.2218	2.3845	0.5042	0.7888	0.4331	0.7213	0.5207	0.7997	0.5385	0.8073	0.3712	0.6606	0.3218	0.6494	0.4431	0.7364	0.4343	0.7441	0.4488	0.7000	0.3433	0.6473	0.4926	0.7429	0.4774	0.7273	0.5504	0.8304	0.4164	0.6069	0.5563	0.8332	0.6255	0.8682	0.6174	0.5025	0.6218	0.5796	0.8486	0.8071	0.8523	0.8213
1.0641	271.4932	120000	1.6957	0.0013	5.4507	2.4464	0.5219	0.7952	0.4388	0.7358	0.5085	0.7924	0.5416	0.8072	0.3651	0.6549	0.3264	0.6533	0.4322	0.7220	0.4344	0.7257	0.4416	0.6912	0.3391	0.6431	0.4815	0.7314	0.4699	0.7186	0.5583	0.8280	0.2630	0.8684	0.5556	0.8310	0.2715	0.864	0.5803	0.5137	0.5326	0.5764	0.8596	0.8076	0.8553	0.8141
1.0325	316.7421	140000	1.7139	0.0013	5.5508	2.4727	0.5157	0.7851	0.4519	0.7212	0.5086	0.7928	0.5415	0.8097	0.3606	0.6478	0.3266	0.6499	0.4412	0.7181	0.4477	0.7166	0.4513	0.7089	0.3402	0.6399	0.4943	0.7441	0.4659	0.7258	0.5564	0.8295	0.6402	0.8639	0.5547	0.8315	0.6388	0.8636	0.624	0.5015	0.6340	0.5750	0.8584	0.8046	0.8349	0.8117
1.0055	361.9910	160000	1.7429	0.0013	5.7141	2.5145	0.5115	0.7872	0.4564	0.7152	0.5147	0.7907	0.5460	0.8055	0.3539	0.6485	0.3489	0.6535	0.4269	0.7125	0.4421	0.7181	0.4443	0.6960	0.3467	0.6383	0.5009	0.7433	0.4872	0.7244	0.5560	0.8298	0.5170	0.7321	0.5551	0.8313	0.6045	0.8634	0.6212	0.5120	0.6032	0.5676	0.8539	0.8041	0.8288	0.8087
0.9802	407.2398	180000	1.7756	0.0013	5.9041	2.5617	0.5087	0.7820	0.4486	0.7114	0.5075	0.7884	0.5330	0.8093	0.3539	0.6427	0.3263	0.6447	0.4325	0.7110	0.4213	0.7319	0.4370	0.6936	0.3527	0.6414	0.4826	0.7369	0.4664	0.7163	0.5564	0.8307	0.6359	0.8618	0.5583	0.8321	0.6241	0.8697	0.6158	0.5085	0.6002	0.5681	0.8618	0.8023	0.8473	0.8108
0.9629	452.4887	200000	1.7887	0.0013	5.9818	2.5806	0.5138	0.7818	0.4410	0.7237	0.5136	0.7931	0.5396	0.8140	0.3578	0.6452	0.3283	0.6480	0.4261	0.7088	0.4253	0.7067	0.4242	0.6919	0.3555	0.6386	0.4777	0.7384	0.4718	0.7186	0.5560	0.8304	0.3553	0.8616	0.5587	0.8313	0.6308	0.8657	0.5793	0.4985	0.5868	0.5687	0.8595	0.8003	0.8277	0.8095

Framework versions

Transformers 4.44.2
Pytorch 2.4.0+cu118
Datasets 2.18.0
Tokenizers 0.19.1

Task: Text Generation
Library: transformers
Type: gpt2
Created: Feb 25, 2025
Updated: Feb 25, 2025