Downloads · 30 days
7
17% of all-time downloads
lora_model
giayphuyen/lora_model
lora_model is a image-text-to-text model from giayphuyen. Use it for the image-text-to-text task on the model card, and read the license before you ship it in a product. It is set up for peft. The card lists the license as mit.
This repository contains LoRA fine-tuned weights for the model deepseek-ai/DeepSeek-OCR, specialized for OCR tasks.
All-time downloads
42
Public
Repo size
311 MB
Likes
0
Public
Repo makeup
Click a slice to open those files.
.safetensors311 MB · 97%
At a glance
- Task
- Image-Text-to-Text
- Library
- peft
- License
- mit
- Access
- Public
- Created
- Dec 12, 2025
- Updated
- Dec 12, 2025
- SHA
- 660e4294
Try a prompt
Base models
Model card
From the Hugging Face model README
LoRA Adapter for DeepSeek-OCR (Vietnamese Bills)
This repository contains LoRA fine-tuned weights for the model deepseek-ai/DeepSeek-OCR, specialized for OCR tasks.
Usage
from transformers import AutoModel, AutoTokenizer
from peft import PeftModel
import torch
base = "deepseek-ai/DeepSeek-OCR"
lora = "giayphuyen/lora_model"
tokenizer = AutoTokenizer.from_pretrained(base, trust_remote_code=True)
model = AutoModel.from_pretrained(base, trust_remote_code=True).cuda()
model = PeftModel.from_pretrained(model, lora)
model = model.eval().to(torch.bfloat16)
prompt = "<image>\nExtract the text."
image = "your_image.jpg"
res = model.infer(
tokenizer,
prompt=prompt,
image_file=image,
output_path=".",
)
print(res)
- Task
- Image-Text-to-Text
- Library
- peft
- License
- mit
- Created
- Dec 12, 2025
- Updated
- Dec 12, 2025