vit-msn-small-finetuned-alzheimers

rhlc/vit-msn-small-finetuned-alzheimers

vit-msn-small-finetuned-alzheimers is a image classification model from rhlc. Use it when you need a label for an image. It is set up for transformers. The card lists the license as apache-2.0.

should probably proofread and complete it, then remove this comment. --

Downloads · 30 days

3% of all-time downloads

All-time downloads

501

Public

Parameters

21.7M

4.9 GB on disk

Likes

Public

Hugging Face

Repo makeup

Click a slice to open those files.

.safetensors86.7 MB · 100%

At a glance

Task: Image Classification
Library: transformers
License: apache-2.0
Model type: vit_msn
Access: Public
Created: Apr 26, 2024
Updated: Apr 26, 2024
SHA: 6c9684bd

Base models

facebook/vit-msn-small

Datasets

imagefolder

Model card

From the Hugging Face model README

vit-msn-small-finetuned-alzheimers

This model is a fine-tuned version of facebook/vit-msn-small on the imagefolder dataset. It achieves the following results on the evaluation set:

Loss: 0.0160
Accuracy: 0.9969

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

learning_rate: 5e-05
train_batch_size: 64
eval_batch_size: 64
seed: 42
gradient_accumulation_steps: 4
total_train_batch_size: 256
optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
lr_scheduler_type: linear
lr_scheduler_warmup_ratio: 0.1
num_epochs: 50

Training results

Training Loss	Epoch	Step	Validation Loss	Accuracy
0.2996	0.9778	22	0.3897	0.8438
0.3703	2.0	45	0.3595	0.8594
0.3087	2.9778	67	0.3777	0.8625
0.486	4.0	90	0.4530	0.8187
0.3307	4.9778	112	0.4560	0.8234
0.306	6.0	135	0.3471	0.8672
0.3005	6.9778	157	0.3025	0.8859
0.319	8.0	180	0.2451	0.8984
0.3489	8.9778	202	0.1814	0.9281
0.3251	10.0	225	0.2451	0.9156
0.3034	10.9778	247	0.1566	0.9406
0.2746	12.0	270	0.2493	0.8922
0.2369	12.9778	292	0.1622	0.9375
0.2231	14.0	315	0.1781	0.9359
0.2281	14.9778	337	0.1268	0.9531
0.2001	16.0	360	0.2431	0.9141
0.183	16.9778	382	0.1017	0.9625
0.1891	18.0	405	0.1802	0.9391
0.1862	18.9778	427	0.0869	0.9766
0.1935	20.0	450	0.1079	0.9688
0.1797	20.9778	472	0.1250	0.9563
0.1605	22.0	495	0.0655	0.9719
0.1848	22.9778	517	0.0806	0.9766
0.1498	24.0	540	0.1116	0.9578
0.1394	24.9778	562	0.0807	0.9672
0.1584	26.0	585	0.0525	0.9797
0.1302	26.9778	607	0.0513	0.9828
0.1356	28.0	630	0.0420	0.9875
0.1101	28.9778	652	0.0354	0.9875
0.1227	30.0	675	0.0583	0.9766
0.1158	30.9778	697	0.0253	0.9906
0.117	32.0	720	0.0231	0.9906
0.1022	32.9778	742	0.0726	0.9797
0.1221	34.0	765	0.0160	0.9969
0.0956	34.9778	787	0.0482	0.9844
0.0856	36.0	810	0.0256	0.9875
0.0996	36.9778	832	0.0211	0.9906
0.0848	38.0	855	0.0446	0.9797
0.1001	38.9778	877	0.0274	0.9875
0.0976	40.0	900	0.0225	0.9922
0.0864	40.9778	922	0.0207	0.9922
0.0865	42.0	945	0.0193	0.9969
0.0773	42.9778	967	0.0203	0.9922
0.075	44.0	990	0.0131	0.9969
0.0761	44.9778	1012	0.0129	0.9938
0.0624	46.0	1035	0.0114	0.9969
0.0557	46.9778	1057	0.0102	0.9953
0.0708	48.0	1080	0.0116	0.9953
0.0667	48.8889	1100	0.0131	0.9953

Framework versions

Transformers 4.40.0
Pytorch 2.2.1+cu121
Datasets 2.19.0
Tokenizers 0.19.1

Task: Image Classification
Library: transformers
Type: vit_msn
License: apache-2.0
Created: Apr 26, 2024
Updated: Apr 26, 2024