A/B Test Designer

ab-test-designer

Design A/B tests with hypotheses, variants, sample sizes, and analysis plans. TRIGGERS - Use when user wants to run A/B tests, split tests, or experiment with variations.

lionelsimai/claude-skills-collection·0installs28starsDesign

SKILL.md

Full skill instructions

A/B Test Designer

Overview

Designs rigorous A/B tests with clear hypotheses, variant specifications, sample size calculations, and analysis plans.

Workflow

Step 1: Define the Test

What are you testing? (page, email, ad, feature)
Current metric: What's the baseline performance?
Goal: What improvement are you hoping for?
Traffic/volume: How many users/emails/impressions per day?

Step 2: Structure the Test

Output Format

# A/B Test: [Test Name]

## Hypothesis
If we [change X], then [metric Y] will [increase/decrease] by [Z%] because [reasoning].

## Test Details
- **Type**: A/B / A/B/C / Multivariate
- **Primary metric**: [what you're measuring]
- **Secondary metrics**: [supporting metrics]
- **Guardrail metrics**: [what shouldn't get worse]

## Variants

### Control (A)
[Description of current experience]

### Variant (B)
[Description of the change]
[Mockup/wireframe description if applicable]

## Sample Size & Duration
- **Baseline conversion**: [X%]
- **Minimum detectable effect**: [X%]
- **Statistical significance**: 95%
- **Required sample size**: [N per variant]
- **Estimated duration**: [X days]

## Analysis Plan
1. Wait for minimum sample size before checking
2. Check primary metric first
3. Segment analysis: [segments to check]
4. If significant: [implementation plan]
5. If not significant: [next steps]

## Risks & Considerations
- [Risk 1]: [mitigation]
- [Risk 2]: [mitigation]

Quality Checklist

Hypothesis is specific and falsifiable
One primary metric defined
Sample size calculated
Duration estimated
Analysis plan prevents peeking bias
Guardrail metrics identified

Install skill

Copy and run in your terminal

npx -y skills add https://github.com/lionelsimai/claude-skills-collection --skill ab-test-designer

View on GitHub

skills/ab-test-designer/SKILL.md

More Design skills

View all

Design

brandkit

Premium brand-kit image generation for high-end identity systems, logo concepts, and visual-world presentations.

92.7K 345.8K

View

Design

image-to-code

Premium website design-to-code skill that generates visual references first, then builds faithful frontend implementations.

92.7K 341.7K

View

Design

imagegen-frontend-web

Premium frontend image direction for landing pages and marketing sites, generating one distinct horizontal image per section.

92.7K 337.8K

View

Design

imagegen-frontend-mobile

Premium mobile app screen concepts and flows with clean hierarchy, strong imagery, and distinctive art direction.

92.7K 331.8K

View

Design

Emil Design Engineering

Emil Kowalski's philosophy on UI polish, component design, and the invisible details that make software feel good.

43.5K 323.4K

View

Design

impeccable

Frontend design and iteration for production-grade interfaces, from concept to ship.

76.8K 313.3K

View

Design

extract-design-system

Reverse-engineer design tokens from public websites into starter token files for your project.

232 129.9K

View

Design

Animate

Builds an animation from scratch by making the decisions in the order that determines whether it feels right.

43.5K 117.9K

View

Design

Create beautiful visual art in .png and .pdf documents using design philosophy. You should use this skill when the user asks to create a poster, piece of art, design, or other static piece. Create original visual designs, never copying existing artists' work to avoid copyright violations.

179.7K 114.2K

View

Design

brand-guidelines

Applies Anthropic's official brand colors and typography to any sort of artifact that may benefit from having Anthropic's look-and-feel. Use it when brand colors or style guidelines, visual formatting, or company design standards apply.

179.7K 100.1K

View

Design

theme-factory

Toolkit for styling artifacts with a theme. These artifacts can be slides, docs, reportings, HTML landing pages, etc. There are 10 pre-set themes with colors/fonts that you can apply to any artifact that has been creating, or can generate a new theme on-the-fly.

179.7K 89.5K

View