Skip to content
role-backend:background-jobs logo

role-backend:background-jobs

Implements background job processing using Bull/BullMQ (Node.js), Celery (Python), Sidekiq (Ruby), and cron scheduling. Covers job prioritization, retry strategies (exponential backoff), dead letter handling, job monitoring, rate-limited queues, and graceful shutdown. Use when offloading work fro...

rnavarych/alpha-engineer0installs15stars

SKILL.md

Full skill instructions

Background Jobs

When to use

  • Offloading slow or unreliable work from HTTP request handlers
  • Choosing a job queue library for a given language and stack
  • Designing retry policies for different job types (email, payment, webhook)
  • Implementing dead letter queues and admin tooling for failed jobs
  • Building multi-step job pipelines or workflows
  • Setting up cron/​scheduled tasks with distributed lock protection
  • Configuring graceful worker shutdown for zero-job-loss deploys

Core principles

  1. Idempotency is non-negotiable — every job runs safely multiple times; design for retries from day one
  2. Pass IDs, not data — fetch fresh state inside the job; stale payloads cause subtle bugs
  3. Retries are tiered by criticality — payment jobs retry 5 times over an hour; analytics sync retries 3 times over 15 minutes
  4. DLQ depth is an alert, not a log — non-zero means someone needs to look at it now
  5. Graceful shutdown beats a kill -9 — always drain in-flight jobs before the process exits

Reference Files

  • references/​job-design-retries-dlq.md — technology selection table, idempotency/​atomicity/​serialization rules, exponential backoff formula, retry config by job type, non-retryable error classification, DLQ setup, job prioritization, and cron scheduling with distributed locks
  • references/​pipelines-shutdown-monitoring.md — BullMQ Flows and Celery chain examples for multi-step workflows, graceful SIGTERM shutdown patterns for Node.js and Python workers, metrics and alerting guidance, and structured log field conventions

More skills from rnavarych

role-architect:migration-planner logo
rnavarych/alpha-engineer

role-architect:migration-planner

Migration planning expertise including strangler fig pattern, parallel run strategy, data migration techniques, feature parity tracking, rollback plans, phased timelines, risk mitigation, and zero-downtime migration.

15 0
View
role-frontend:state-management logo
rnavarych/alpha-engineer

role-frontend:state-management

State management expertise including local vs global state decisions, Redux Toolkit, Zustand, Jotai, MobX, Context API patterns, server state (React Query, SWR) vs client state, optimistic updates, and state machines with XState.

15 0
View
role-devops:terraform-expert logo
rnavarych/alpha-engineer

role-devops:terraform-expert

Terraform and Infrastructure as Code expertise covering HCL module design, state management, workspaces, provider configuration, drift detection, Terragrunt, infrastructure testing, and resource lifecycle management.

15 0
View
role-aqa:test-data-management logo
rnavarych/alpha-engineer

role-aqa:test-data-management

Test data management with factory patterns (Faker.js, Fishery, Factory Bot), database seeding, test data isolation (transactions, cleanup), anonymization and masking for production data, synthetic data generation, fixture management, and shared test state risks. Use when designing test data strat...

15 0
View
mobile-flutter logo
rnavarych/alpha-engineer

mobile-flutter

Flutter 3.27+ patterns — Riverpod 2 state with codegen, GoRouter 14+ navigation, Impeller rendering (default on all platforms), WASM web, extension types, on-device AI (firebase_ai, MediaPipe), Patrol 3.x testing, platform channels, performance

15 0
View
role-architect:gcp-architect logo
rnavarych/alpha-engineer

role-architect:gcp-architect

GCP architecture expertise including Google Cloud Architecture Framework, project and organization structure, VPC and networking design, data and analytics architecture, Kubernetes and serverless patterns, AI/ML platform design, security architecture, and cost optimization strategies. Use proacti...

15 0
View
role-aqa:ci-test-integration logo
rnavarych/alpha-engineer

role-aqa:ci-test-integration

CI/CD test integration: parallel test execution (sharding), test splitting strategies, flaky test quarantine, test reporting (Allure, ReportPortal, JUnit XML), quality gates (coverage thresholds, no new failures), test result caching, and pre-commit hooks. Use when configuring test pipelines, opt...

15 0
View
role-devops:monitoring-setup logo
rnavarych/alpha-engineer

role-devops:monitoring-setup

Monitoring and observability expertise covering Prometheus/Grafana stack, Datadog, CloudWatch, PagerDuty integration, custom metrics, dashboard design using USE/RED methods, alert routing, uptime monitoring, and log aggregation.

15 0
View
role-frontend:vue-expert logo
rnavarych/alpha-engineer

role-frontend:vue-expert

Vue.js expertise including Composition API, Pinia state management, Nuxt.js 3, Vue Router, custom directives, provide/inject patterns, transition system, and Volar tooling configuration.

15 0
View
alpha-core:observability logo
rnavarych/alpha-engineer

alpha-core:observability

Sets up observability: structured logging, metrics collection, distributed tracing, alerting rules, dashboard design, SLI/SLO/SLA definition. Covers ELK, Prometheus, Grafana, Datadog, OpenTelemetry. Use when implementing monitoring, debugging production issues, or designing observability architec...

15 0
View
metrics-analytics logo
rnavarych/alpha-engineer

metrics-analytics

Product analytics: AARRR framework, North Star Metric, A/B testing with statistical significance (95% confidence, minimum detectable effect), PostHog event tracking, funnel analysis, retention cohorts, feature flags for experiments. Vanity metrics vs actionable metrics. Use when defining KPIs, de...

15 0
View
billy-voice-ru logo
rnavarych/alpha-engineer

billy-voice-ru

Russian language calibration for Billy Milligan agents. Load when session language is RU. Contains native speech patterns, swearing vocabulary, pet name styles, and anchor examples for all 5 agents.

15 0
View

Popular AI tools

Kaiber logo
Video

Kaiber

Generate, edit, and beat-sync AI video with leading models in one workspace.

Paid
View
Vimcal logo
Productivity

Vimcal

The world's fastest calendar for remote work

Free
View

Transform Your Design with AI Designer by ImgCreator.ai

Freemium
View
Akool AI logo
Content & writing

Akool AI

Revolutionizing Video Production with AI-Powered Creativity

Paid
View

Extend an image past the frame and let AI fill the new aspect ratio.

Freemium
View
StarByFace logo
Security

StarByFace

Discover your celebrity doppelgänger with StarByFace!

Free
View
C

ChainClarity explains 700+ crypto whitepapers in plain English, with layered summaries, comparisons, research tools, alerts, and a $4.99 Pro plan.

Freemium
View
Opus Clip logo
Coding & apps

Opus Clip

Opus.ai: Revolutionize Your Web Experience

Free
View