Omniverse-v1

Omniverse-v1

Omniverse-v1 is a powerful Vision-Language Model (VLM) customized for Intelligent Document Processing (IDP). It is designed to understand complex document layouts, such as dense mark sheets, invoices, and unstructured PDFs, and natively extract beautifully structured Markdown.

🚀 Features

• Table Recognition: Perfectly extracts grids and nested tables into native Markdown format.
• Formula & Chart Parsing: Capable of understanding and extracting complex visual data.
• Robust OCR: Reads dense, multi-column text effortlessly.

💻 Usage

This model is intended to be used with the Omniverse Python/Gradio pipeline.

from transformers import AutoModelForCausalLM, AutoProcessor
import torch

model_id = "ManvithReddy/Omniverse-v1"

# Load the processor and model
processor = AutoProcessor.from_pretrained(model_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    model_id, 
    trust_remote_code=True, 
    torch_dtype=torch.bfloat16
).eval()

📖 Origins

This model is derived from the PaddleOCR-VL architecture and customized for local, offline document extraction tasks under the Omniverse initiative.