Downloads · 30 days
14
33% of all-time downloads
trocr-pl-mixed-v1
PiotrSty/trocr-pl-mixed-v1
trocr-pl-mixed-v1 is a image-text-to-text model from PiotrSty. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for transformers. The card lists the license as apache-2.0.
Fine-tune of PiotrSty/trocr-pl-base on synthetic Polish print + real EHRI typewritten Polish lines (CC-BY 4.0, ehri-pl-lines).
All-time downloads
43
Public
Parameters
334M
1.3 GB on disk
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors1.3 GB · 100%
At a glance
- Task
- Image-Text-to-Text
- Library
- transformers
- License
- apache-2.0
- Model type
- vision-encoder-decoder
- Access
- Public
- Created
- Sep 14, 2026
- Updated
- Sep 14, 2026
- SHA
- b8e4c4e2
Base models
Model card
From the Hugging Face model README
PiotrSty/trocr-pl-mixed-v1 (experimental)
Fine-tune of PiotrSty/trocr-pl-base on synthetic Polish print + real EHRI typewritten Polish lines (CC-BY 4.0, ehri-pl-lines).
Training
- Base: PiotrSty/trocr-pl-base
- Method: QLoRA, decoder attn q/k/v/out_proj, rank 16, alpha 32
- Train: 2000 synthetic + 349 real EHRI lines (3 docs)
- Val: 38 EHRI lines (held-out doc ZIH3010905)
- Epochs: 5, batch 8, lr 2e-4, T4 x2
- Best checkpoint: checkpoint-735 (val CER 0.3351)
- Document-level split, no line leakage.
Evaluation on frozen held-out sets
| Model | EHRI test (81, typewriter) | real-lines-v1 (75, print) |
|---|---|---|
| trocr-pl-base (run2) | CER 47.30% / WER 90.82% | CER 11.11% / WER 35.84% |
| trocr-pl-mixed-v1 (run3) | CER 33.95% / WER 85.69% | CER 7.09% / WER 29.44% |
Mixed fine-tuning improved BOTH domains (typewriter -28% CER, print -36% CER).
Limitations
- Typewriter WER still ~86%; word-level weak.
- Only 349 real typewritten lines; more data should help.
- Page segmentation on faded typewriter is unreliable; this is a line recognizer.
- Do NOT use as drop-in replacement for trocr-pl-base without your own eval.
Provenance
See run.json, selection.json, best_metrics.json in this repo. Source: https://github.com/PiotrStyla/OCR_engine (commit 7065e6a) EHRI dataset: https://huggingface.co/datasets/PiotrSty/ehri-pl-lines
- Task
- Image-Text-to-Text
- Library
- transformers
- Type
- vision-encoder-decoder
- License
- apache-2.0
- Languages
- pl
- Created
- Sep 14, 2026
- Updated
- Sep 14, 2026