DAG Authoring Skill

authoring-dags

Workflow and best practices for writing Apache Airflow DAGs. Use when the user wants to create a new DAG, write pipeline code, or asks about DAG patterns and conventions. For testing and debugging DAGs, see the testing-dags skill.

necatiarslan/airflow-vscode-extension·0installs44stars

SKILL.md

Full skill instructions

DAG Authoring Skill

This skill guides you through creating and validating Airflow DAGs using best practices and the VS Code extension tools.

For testing and debugging DAGs, see the testing-dags skill.

Critical Warning: Use Extension Tools

Use the Airflow VS Code extension tools for all Airflow operations. Avoid running Airflow CLI commands for listing DAGs, checking logs, or inspecting runs.

Workflow Overview

Discover
Plan
Implement
Validate
Test (with user consent)
Iterate

Phase 1: Discover

Explore the codebase

Use file tools to find existing patterns:

Search for existing DAGs in the repo
Read similar DAGs for conventions
Check requirements and providers in use

Query Airflow via extension tools

Use these tools to understand the environment:

list_active_dags and list_paused_dags for naming conventions
get_running_dags for current activity
get_dag_history to see run cadence
go_to_connections_view and go_to_variables_view for configuration
go_to_providers_view and go_to_plugins_view for installed components
go_to_server_health_view for health checks

Phase 2: Plan

Propose:

DAG structure (tasks, dependencies, schedule)
Operators to use
Connections and variables needed
Package changes if required

Get user approval before implementing.

Phase 3: Implement

Create or update the DAG file
Update dependencies if needed
Save the file

Phase 4: Validate

After the DAG is deployed to Airflow, validate via tools:

Confirm the DAG appears in list_active_dags or list_paused_dags
Use get_dag_source_code to verify the deployed source
Review run history with get_dag_history

Phase 5: Test

Follow the testing-dags skill:

Ask for consent
Trigger with trigger_dag_run
Review results with get_dag_runs and analyse_dag_latest_run

Notes

Avoid CLI checks like airflow dags list or astro dev run for operational status.
Use the extension tools for runtime investigation and logs.

Install skill

Copy and run in your terminal

npx -y skills add https://github.com/necatiarslan/airflow-vscode-extension --skill authoring-dags

View on GitHub

skills/authoring-dags/SKILL.md

awsclaw-apigateway
Manage and inspect AWS API Gateway REST APIs, resources, methods, stages, authorizers, usage plans, and domain names using the awsclaw VS Code extension APIGatewayTool.
0 installs
awsclaw-dynamodb
Manage Amazon DynamoDB tables and items using awsclaw. Create/delete/update tables, query and scan data, CRUD operations on items, manage TTL, backups, global tables, auto-scaling, and tags.
0 installs
awsclaw-stepfunc
Manage and run AWS Step Functions state machines, executions, and activities using the awsclaw VS Code extension StepFuncTool.
0 installs
awsclaw-sns
Manage Amazon SNS topics, subscriptions, publishing, platform applications, SMS, and endpoints using awsclaw. Create, configure, and delete resources, publish messages, and check SMS/sandbox status.
0 installs

More skills from necatiarslan

necatiarslan/awsclaw

awsclaw-glue

Manage AWS Glue ETL jobs, triggers, crawlers, databases, tables, workflows, and connections using awsclaw. Create, update, and delete resources, inspect crawl history, and manage tags.

1 0

View

necatiarslan/awsclaw

awsclaw-general

General AWS management in VS Code using awsclaw extension. Covers AWS connectivity, session management, profiles, regions, endpoints, file operations, testing connections, safety model, cross-service discovery, and extension capabilities.

1 0

View

necatiarslan/awsclaw

awsclaw-rds

Manage and inspect Amazon RDS instances, clusters, snapshots, parameter groups, logs, proxies, events, engine versions, subnet groups, security groups, certificates, recommendations, and more using awsclaw.

1 0

View

necatiarslan/awsclaw

awsclaw-ec2

Manage and query AWS EC2 resources including launching/stopping/terminating instances, creating VPCs and subnets, managing security groups, volumes, snapshots, AMIs, and querying all EC2 resource types using awsclaw. Full lifecycle management.

1 0

View

necatiarslan/awsclaw

awsclaw-lambda

Manage AWS Lambda functions using awsclaw. Create, update, invoke, and delete functions, manage aliases/versions, event source mappings, layers, tags, function URLs, concurrency, and code signing.

1 0

View

necatiarslan/airflow-vscode-extension

tracing-downstream-lineage

Map downstream lineage and blast radius for Airflow data assets. Use when the user needs to know which DAGs, tables, dashboards, or models depend on a dataset and what could break after a change.

44 0

View

necatiarslan/airflow-vscode-extension

airflow

Manages Apache Airflow operations including listing, running, and debugging DAGs, viewing logs, and checking server status using the VS Code extension tools.

44 0

View

necatiarslan/airflow-vscode-extension

creating-openlineage-extractors

Create custom OpenLineage extractors for Airflow operators. Use when the user needs lineage from unsupported or third-party operators, wants column-level lineage, or needs complex extraction logic beyond what inlets/outlets provide.

44 0

View

necatiarslan/airflow-vscode-extension

setting-up-astro-project

Initialize and configure Astro/Airflow projects. Use when the user wants to create a new project, set up dependencies, configure connections/variables, or understand project structure. For running the local environment, see managing-astro-local-env.

44 0

View

necatiarslan/table-faker

tablefaker

Generate YAML configs for Tablefaker to create synthetic datasets with tables, relationships, and faker data.

19 0

View

necatiarslan/awsclaw

awsclaw-s3-fileops

Upload and download files and folders to/from Amazon S3 with folder structure preservation using awsclaw. Bulk file transfers, folder uploads, folder downloads.

1 0

View

necatiarslan/airflow-vscode-extension

testing-dags

Complex DAG testing workflows with debugging and fixing cycles. Use for multi-step testing requests like "test this dag and fix it if it fails", "test and debug", "run the pipeline and troubleshoot issues".

44 0

View