Performance Regression Detector

detecting-performance-regressions

Automatically detect performance regressions in CI/CD pipelines by comparing metrics against baselines. Use when validating builds or analyzing performance trends. Trigger with phrases like "detect performance regression", "compare performance metrics", or "analyze performance degradation".

Dicklesworthstone/pi_agent_rust·0installs1.8Kstars

SKILL.md

Full skill instructions

Performance Regression Detector

This skill provides automated assistance for performance regression detector tasks.

Overview

This skill automates the detection of performance regressions within a CI/CD pipeline. It utilizes various methods, including baseline comparison, statistical analysis, and threshold violation checks, to identify performance degradation. The skill provides insights into potential performance bottlenecks and helps maintain application performance.

How It Works

Analyze Performance Data: The plugin gathers performance metrics from the CI/CD environment.
Detect Regressions: It employs methods like baseline comparison, statistical analysis, and threshold checks to detect regressions.
Report Findings: The plugin generates a report summarizing the detected performance regressions and their potential impact.

When to Use This Skill

This skill activates when you need to:

Identify performance regressions in a CI/CD pipeline.
Analyze performance metrics for potential degradation.
Compare current performance against historical baselines.

Examples

Example 1: Identifying a Response Time Regression

User request: "Detect performance regressions in the latest build. Specifically, check for increases in response time."

The skill will:

Analyze response time metrics from the latest build.
Compare the response times against a historical baseline.
Report any statistically significant increases in response time that exceed a defined threshold.

Example 2: Detecting Throughput Degradation

User request: "Analyze throughput for performance regressions after the recent code merge."

The skill will:

Gather throughput data (requests per second) from the post-merge CI/CD run.
Compare the throughput to pre-merge values, looking for statistically significant drops.
Generate a report highlighting any throughput degradation, indicating a potential performance regression.

Best Practices

Define Baselines: Establish clear and representative performance baselines for accurate comparison.
Set Thresholds: Configure appropriate thresholds for identifying significant performance regressions.
Monitor Key Metrics: Focus on monitoring critical performance metrics relevant to the application's behavior.

Integration

This skill can be integrated with other CI/CD tools to automatically trigger regression detection upon new builds or code merges. It can also be combined with reporting plugins to generate detailed performance reports.

Prerequisites

Historical performance baselines in {baseDir}/performance/baselines/
Access to CI/CD performance metrics
Statistical analysis tools
Defined regression thresholds

Instructions

Collect performance metrics from current build
Load historical baseline data
Apply statistical analysis to detect significant changes
Check for threshold violations
Identify specific regressed metrics
Generate regression report with root cause analysis

Output

Performance regression detection report
Statistical comparison with baselines
List of regressed metrics with severity
Visualization of performance trends
Recommendations for investigation

Error Handling

If regression detection fails:

Verify baseline data availability
Check metrics collection configuration
Validate statistical analysis parameters
Ensure threshold definitions are valid
Review CI/CD integration setup

Resources

Statistical process control for performance testing
CI/CD performance testing best practices
Regression detection algorithms
Performance monitoring strategies

Install skill

Copy and run in your terminal

npx -y skills add https://github.com/Dicklesworthstone/pi_agent_rust --skill detecting-performance-regressions

View on GitHub

tests/ext_conformance/artifacts/plugins-community/plugins/performance/performance-regression-detector/skills/detecting-performance-regressions/SKILL.md

deepgram-hello-world
Create a minimal working Deepgram transcription example. Use when starting a new Deepgram integration, testing your setup, or learning basic Deepgram API patterns. Trigger with phrases like "deepgram hello world", "deepgram example", "deepgram quick start", "simple transcription", "transcribe aud...
0 installs
interactive-shell
Cheat sheet + workflow for launching interactive coding-agent CLIs (Claude Code, Gemini CLI, Codex CLI, Cursor CLI, and pi itself) via the interactive_shell overlay or headless dispatch. Use for TUI agents and long-running processes that need supervision, fire-and-forget delegation, or headless b...
0 installs
documenso-prod-checklist
Execute Documenso production deployment checklist and rollback procedures. Use when deploying Documenso integrations to production, preparing for launch, or implementing go-live procedures. Trigger with phrases like "documenso production", "deploy documenso", "documenso go-live", "documenso launc...
0 installs
interactive-portfolio
Expert in building portfolios that actually land jobs and clients - not just showing work, but creating memorable experiences. Covers developer portfolios, designer portfolios, creative portfolios, and portfolios that convert visitors into opportunities. Use when: portfolio, personal website, sho...
0 installs