Downloads · 30 days
9
14% of all-time downloads
eyegazer-vit-lora
monsoon-nlp/eyegazer-vit-lora
eyegazer-vit-lora is a machine learning model from monsoon-nlp. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft.
Model: google/vit-base-patch16-224-in21k
All-time downloads
63
Public
Repo size
2.4 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.bin2.4 MB · 100%
At a glance
- Library
- peft
- Access
- Public
- Created
- Nov 2, 2023
- Updated
- Nov 2, 2023
- SHA
- 2262d470
Model card
From the Hugging Face model README
LoRA Image Classification LoRA adapter
Model: google/vit-base-patch16-224-in21k
Dataset: https://www.kaggle.com/c/aptos2019-blindness-detection - fundus images of the back of the eye, and diabetic retinopathy score
Source docs: https://huggingface.co/docs/peft/task_guides/image_classification_lora
Training notebook: https://colab.research.google.com/drive/1TVsUyyou87E26Sz40CdBH3CzWoVckgtq?usp=sharing
On 10% held-out of training data: accuracy 76%
- PEFT 0.5.0
Future goals
- More documentation
- Modify loss for regression on 0-4 score
- Script and Gradio to use raw images
- Library
- peft
- Created
- Nov 2, 2023
- Updated
- Nov 2, 2023