Skip to content
computer-vision-expert logo

Computer Vision Expert (SOTA 2026)

computer-vision-expert

SOTA Computer Vision Expert (2026). Specialized in YOLO26, Segment Anything 3 (SAM 3), Vision Language Models, and real-time spatial analysis.

SKILL.md

Full skill instructions

Computer Vision Expert (SOTA 2026)

Role: Advanced Vision Systems Architect & Spatial Intelligence Expert

Purpose

To provide expert guidance on designing, implementing, and optimizing state-of-the-art computer vision pipelines. From real-time object detection with YOLO26 to foundation model-based segmentation with SAM 3 and visual reasoning with VLMs.

When to Use

  • Designing high-performance real-time detection systems (YOLO26).
  • Implementing zero-shot or text-guided segmentation tasks (SAM 3).
  • Building spatial awareness, depth estimation, or 3D reconstruction systems.
  • Optimizing vision models for edge device deployment (ONNX, TensorRT, NPU).
  • Needing to bridge classical geometry (calibration) with modern deep learning.

Capabilities

1. Unified Real-Time Detection (YOLO26)

  • NMS-Free Architecture: Mastery of end-to-end inference without Non-Maximum Suppression (reducing latency and complexity).
  • Edge Deployment: Optimization for low-power hardware using Distribution Focal Loss (DFL) removal and MuSGD optimizer.
  • Improved Small-Object Recognition: Expertise in using ProgLoss and STAL assignment for high precision in IoT and industrial settings.

2. Promptable Segmentation (SAM 3)

  • Text-to-Mask: Ability to segment objects using natural language descriptions (e.g., "the blue container on the right").
  • SAM 3D: Reconstructing objects, scenes, and human bodies in 3D from single/​multi-view images.
  • Unified Logic: One model for detection, segmentation, and tracking with 2x accuracy over SAM 2.

3. Vision Language Models (VLMs)

  • Visual Grounding: Leveraging Florence-2, PaliGemma 2, or Qwen2-VL for semantic scene understanding.
  • Visual Question Answering (VQA): Extracting structured data from visual inputs through conversational reasoning.

4. Geometry & Reconstruction

  • Depth Anything V2: State-of-the-art monocular depth estimation for spatial awareness.
  • Sub-pixel Calibration: Chessboard/​Charuco pipelines for high-precision stereo/​multi-camera rigs.
  • Visual SLAM: Real-time localization and mapping for autonomous systems.

Patterns

1. Text-Guided Vision Pipelines

  • Use SAM 3's text-to-mask capability to isolate specific parts during inspection without needing custom detectors for every variation.
  • Combine YOLO26 for fast "candidate proposal" and SAM 3 for "precise mask refinement".

2. Deployment-First Design

  • Leverage YOLO26's simplified ONNX/​TensorRT exports (NMS-free).
  • Use MuSGD for significantly faster training convergence on custom datasets.

3. Progressive 3D Scene Reconstruction

  • Integrate monocular depth maps with geometric homographies to build accurate 2.5D/​3D representations of scenes.

Anti-Patterns

  • Manual NMS Post-processing: Stick to NMS-free architectures (YOLO26/​v10+) for lower overhead.
  • Click-Only Segmentation: Forgetting that SAM 3 eliminates the need for manual point prompts in many scenarios via text grounding.
  • Legacy DFL Exports: Using outdated export pipelines that don't take advantage of YOLO26's simplified module structure.

Sharp Edges (2026)

IssueSeveritySolution
SAM 3 VRAM UsageMediumUse quantized/​distilled versions for local GPU inference.
Text AmbiguityLowUse descriptive prompts ("the 5mm bolt" instead of just "bolt").
Motion BlurMediumOptimize shutter speed or use SAM 3's temporal tracking consistency.
Hardware CompatibilityLowYOLO26 simplified architecture is highly compatible with NPU/​TPUs.

Related Skills

ai-engineer, robotics-expert, research-engineer, embedded-systems

More skills from MudassarAbrar

azure-monitor-opentelemetry-ts logo
MudassarAbrar/SAGE__GEMINI_LIVE_AGENT_HACKATHON

azure-monitor-opentelemetry-ts

Instrument applications with Azure Monitor and OpenTelemetry for JavaScript (@azure/monitor-opentelemetry). Use when adding distributed tracing, metrics, and logs to Node.js applications with Appli...

3 0
View
popup-cro logo
MudassarAbrar/SAGE__GEMINI_LIVE_AGENT_HACKATHON

popup-cro

Create and optimize popups, modals, overlays, slide-ins, and banners to increase conversions without harming user experience or brand trust.

3 0
View
mtls-configuration logo
MudassarAbrar/SAGE__GEMINI_LIVE_AGENT_HACKATHON

mtls-configuration

Configure mutual TLS (mTLS) for zero-trust service-to-service communication. Use when implementing zero-trust networking, certificate management, or securing internal service communication.

3 0
View
azure-cosmos-db-py logo
MudassarAbrar/SAGE__GEMINI_LIVE_AGENT_HACKATHON

azure-cosmos-db-py

Build Azure Cosmos DB NoSQL services with Python/FastAPI following production-grade patterns. Use when implementing database client setup with dual auth (DefaultAzureCredential + emulator), service...

3 0
View
terraform-infrastructure logo
MudassarAbrar/SAGE__GEMINI_LIVE_AGENT_HACKATHON

terraform-infrastructure

Terraform infrastructure as code workflow for provisioning cloud resources, creating reusable modules, and managing infrastructure at scale.

3 0
View
one-drive-automation logo
MudassarAbrar/SAGE__GEMINI_LIVE_AGENT_HACKATHON

one-drive-automation

Automate OneDrive file management, search, uploads, downloads, sharing, permissions, and folder operations via Rube MCP (Composio). Always search tools first for current schemas.

3 0
View
memory-safety-patterns logo
MudassarAbrar/SAGE__GEMINI_LIVE_AGENT_HACKATHON

memory-safety-patterns

Implement memory-safe programming with RAII, ownership, smart pointers, and resource management across Rust, C++, and C. Use when writing safe systems code, managing resources, or preventing memory...

3 0
View
fp-ts-errors logo
MudassarAbrar/SAGE__GEMINI_LIVE_AGENT_HACKATHON

fp-ts-errors

Handle errors as values using fp-ts Either and TaskEither for cleaner, more predictable TypeScript code. Use when implementing error handling patterns with fp-ts.

3 0
View
framework-migration-code-migrate logo
MudassarAbrar/SAGE__GEMINI_LIVE_AGENT_HACKATHON

framework-migration-code-migrate

You are a code migration expert specializing in transitioning codebases between frameworks, languages, versions, and platforms. Generate comprehensive migration plans, automated migration scripts, and

3 0
View
azure-ai-voicelive-java logo
MudassarAbrar/SAGE__GEMINI_LIVE_AGENT_HACKATHON

azure-ai-voicelive-java

Real-time, bidirectional voice conversations with AI assistants using WebSocket technology.

3 0
View
agent-memory-mcp logo
MudassarAbrar/SAGE__GEMINI_LIVE_AGENT_HACKATHON

agent-memory-mcp

A hybrid memory system that provides persistent, searchable knowledge management for AI agents (Architecture, Patterns, Decisions).

3 0
View
windows-privilege-escalation logo
MudassarAbrar/SAGE__GEMINI_LIVE_AGENT_HACKATHON

windows-privilege-escalation

This skill should be used when the user asks to \"escalate privileges on Windows,\" \"find Windows privesc vectors,\" \"enumerate Windows for privilege escalation,\" \"exploit Windows miscon...

3 0
View

Popular AI tools

Kaiber logo
Video

Kaiber

Generate, edit, and beat-sync AI video with leading models in one workspace.

Paid
View
Vimcal logo
Productivity

Vimcal

The world's fastest calendar for remote work

Free
View

Transform Your Design with AI Designer by ImgCreator.ai

Freemium
View
Akool AI logo
Content & writing

Akool AI

Revolutionizing Video Production with AI-Powered Creativity

Paid
View

Extend an image past the frame and let AI fill the new aspect ratio.

Freemium
View
StarByFace logo
Security

StarByFace

Discover your celebrity doppelgänger with StarByFace!

Free
View
C

ChainClarity explains 700+ crypto whitepapers in plain English, with layered summaries, comparisons, research tools, alerts, and a $4.99 Pro plan.

Freemium
View
Opus Clip logo
Coding & apps

Opus Clip

Opus.ai: Revolutionize Your Web Experience

Free
View