resnet-50-text-detector

Model Card for ResNet-50 Text Detector

This model was trained with the intent to quickly classify whether or not an image contains legible text or not. It was trained as a binary classification problem on the COCO-Text dataset together with some images from LLaVAR. This came out to a total of ~70k images, where 50% of them had text and 50% of them had no legible text.

Model Details

How to Get Started with the Model

from PIL import Image
import requests

from transformers import AutoImageProcessor, AutoModelForImageClassification

model = AutoModelForImageClassification.from_pretrained(
    "miguelcarv/resnet-50-text-detector",
)

processor = AutoImageProcessor.from_pretrained("microsoft/resnet-50", do_resize=False)

url = "http://images.cocodataset.org/train2017/000000044520.jpg"
image = Image.open(requests.get(url, stream=True).raw).convert('RGB').resize((256,256))

inputs = processor(image, return_tensors="pt").pixel_values

outputs = model(inputs)
logits_per_image = outputs.logits 
probs = logits_per_image.softmax(dim=1) 
print(probs)
# tensor([[0.1149, 0.8851]])

Training Details

• Trained for three epochs
• Resolution: 256x256
• Learning rate: 5e-5
• Optimizer: AdamW
• Batch size: 64
• Trained with FP32