Downloads · 30 days
10
17% of all-time downloads
apprentice-qwen35-4b-lora-document-types
singhabhishekkk/apprentice-qwen35-4b-lora-document-types
apprentice-qwen35-4b-lora-document-types is a machine learning model from singhabhishekkk. Use it for the machine learning task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as apache-2.0.
LoRA adapter fine-tuned on 140 golden examples from a corrected Tobacco3482 OCR-text dataset to classify one document type from: ADVE, Email, Form, Letter, Memo, News, Note, Report, Resume, Scientific.
All-time downloads
60
Public
Repo size
190 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors85 MB · 81%
At a glance
- Library
- peft
- License
- apache-2.0
- Access
- Public
- Created
- Jul 10, 2026
- Updated
- Jul 10, 2026
- SHA
- fb2d4530
Base models
Model card
From the Hugging Face model README
Apprentice Qwen3.5-4B LoRA (document type classification)
LoRA adapter fine-tuned on 140 golden examples from a corrected Tobacco3482 OCR-text dataset to classify one document type from: ADVE, Email, Form, Letter, Memo, News, Note, Report, Resume, Scientific.
The input prompt is the verbatim shipped document-type prompt from icereed/paperless-gpt, filled with English, the allowed type list, an empty title, and OCR text capped at about 4,000 characters.
Results (60 held-out rows, exact match)
| System | Score |
|---|---|
| gpt-5.4-mini, shipped paperless-gpt prompt | 78.33 |
| gpt-5.4-mini, GEPA-optimized | 81.67 |
| Qwen3.5-4B raw | 71.67 |
| Qwen3.5-4B fine-tuned (this adapter) | 80.00 |
The fine-tune beats the frontier model as paperless-gpt ships it (78.33) and lands 1.67 short of the GEPA-optimized teacher.
Training
LoRA r=16, alpha 16, 3 epochs, lr 2e-4, batch 2 x grad-accum 4, Unsloth 4-bit, Colab GPU. Train/eval split: seed 42, 140/60 from 200 sampled rows, identical split across every model this task is fine-tuned on.
Usage
Load with PEFT on top of Qwen/Qwen3.5-4B, or serve locally with an adapter-capable runtime. Caveat: evaluated on 60 rows for one field only. Re-validate on your paperless-ngx document types before production use.
- Library
- peft
- License
- apache-2.0
- Created
- Jul 10, 2026
- Updated
- Jul 10, 2026