Skip to content
LiveNew tools this week
Submit
AIMarketly
azure-data-explorer logo

Azure Data Explorer Skill

azure-data-explorer

Expert knowledge for Azure Data Explorer development including troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. Use when configuring ADX clusters, private endpoints, follower...

MicrosoftDocs/Agent-Skills0installs773stars

SKILL.md

Full skill instructions

Azure Data Explorer Skill

This skill provides expert guidance for Azure Data Explorer. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

  • Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
  • Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/​markdown. Returns Markdown.

Category Index

CategoryLinesDescription
TroubleshootingL37-L48Diagnosing and fixing ADX cluster health, creation, connection, private endpoint, ingestion, and DB/​table operation errors, including interpreting ingestion error codes and using Resource Health.
Best PracticesL49-L59Guidance on ADX performance and reliability: schema design, handling duplicates, JSON ingestion, monitoring queued ingestion, hot/​cold data querying, high concurrency, and Power BI integration.
Decision MakingL60-L74Guidance on ADX cluster sizing and SKUs, cost and reservations, business continuity, confidential/​isolated compute, streaming ingestion choices, and migrating from Elasticsearch.
Architecture & Design PatternsL75-L81Patterns for ADX deployment: regional DR and replication, cross-cluster access via follower DBs, and multitenant cluster/​database design choices.
Limits & QuotasL82-L92Cluster limits and behaviors: free cluster quotas, auto-stop, safe delete/​recover, ingestion file size and invalid data handling, and supported data/​compression formats.
SecurityL93-L120Configuring ADX security: auth/​RBAC, managed identities, encryption/​CMK, network isolation (private endpoints, outbound/​public access), policies, compliance, and data privacy (purge).
ConfigurationL121-L136Configuring ADX clusters, schemas, policies, plugins, and data connections, plus emulator setup, KQL/​T-SQL use, monitoring refs, and web UI settings/​profiles/​shortcuts.
Integrations & Coding PatternsL137-L170Integrating ADX with tools and services (SQL, ODBC/​JDBC, Power Automate/​Apps, Functions, Grafana, Splunk, OpenTelemetry, Tableau, MATLAB, etc.) and coding/​query patterns for those connections.
DeploymentL171-L177Provisioning and automating ADX environments, deploying schema via Azure DevOps, and migrating clusters to availability zones and from VNet injection to private endpoints.

Troubleshooting

TopicURL
Monitor and troubleshoot Azure Data Explorer cluster healthhttps://learn.microsoft.com/en-us/azure/data-explorer/check-cluster-health
Interpret ADX ingestion error codes and failureshttps://learn.microsoft.com/en-us/azure/data-explorer/error-codes
Resolve common Azure Data Explorer ingestion issueshttps://learn.microsoft.com/en-us/azure/data-explorer/ingestion-faq
Use Resource Health to diagnose ADX issueshttps://learn.microsoft.com/en-us/azure/data-explorer/monitor-with-resource-health
Troubleshoot Azure Data Explorer private endpoint issueshttps://learn.microsoft.com/en-us/azure/data-explorer/security-network-private-endpoint-troubleshoot
Fix Azure Data Explorer cluster connection issueshttps://learn.microsoft.com/en-us/azure/data-explorer/troubleshoot-connect-cluster
Troubleshoot Azure Data Explorer cluster creation failureshttps://learn.microsoft.com/en-us/azure/data-explorer/troubleshoot-create-cluster
Resolve Azure Data Explorer DB and table operation failureshttps://learn.microsoft.com/en-us/azure/data-explorer/troubleshoot-database-table

Best Practices

TopicURL
Handle duplicate data in Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/dealing-with-duplicates
Optimize Azure Data Explorer clusters for high-concurrency workloadshttps://learn.microsoft.com/en-us/azure/data-explorer/high-concurrency
Use hot windows to efficiently query cold data in Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/hot-windows
Ingest JSON into Azure Data Explorer with KQL, C#, and Pythonhttps://learn.microsoft.com/en-us/azure/data-explorer/ingest-json-formats
Monitor queued ingestion metrics in ADXhttps://learn.microsoft.com/en-us/azure/data-explorer/monitor-queued-ingestion
Apply Power BI best practices for Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/power-bi-best-practices
Optimize Azure Data Explorer table schema designhttps://learn.microsoft.com/en-us/azure/data-explorer/schema-best-practice

Decision Making

TopicURL
Choose Azure Data Explorer business continuity optionshttps://learn.microsoft.com/en-us/azure/data-explorer/business-continuity-overview
Deploy Azure Data Explorer with confidential computehttps://learn.microsoft.com/en-us/azure/data-explorer/confidential-compute
Decide when to use streaming ingestion in Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/ingest-data-streaming
Select isolated compute SKUs for Data Explorer clustershttps://learn.microsoft.com/en-us/azure/data-explorer/isolated-compute
Choose optimal Azure Data Explorer compute SKUhttps://learn.microsoft.com/en-us/azure/data-explorer/manage-cluster-choose-sku
Plan vertical scaling and SKU changes for clustershttps://learn.microsoft.com/en-us/azure/data-explorer/manage-cluster-vertical-scaling
Migrate Elasticsearch workloads to Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/migrate-elasticsearch-to-azure-data-explorer
Use ADX pricing calculator for cluster planninghttps://learn.microsoft.com/en-us/azure/data-explorer/pricing-calculator
Optimize ADX cost per GB ingestedhttps://learn.microsoft.com/en-us/azure/data-explorer/pricing-cost-drivers
Understand ADX reservation discount applicationhttps://learn.microsoft.com/en-us/azure/data-explorer/pricing-reservation-discount
Buy ADX reserved capacity to reduce markup costshttps://learn.microsoft.com/en-us/azure/data-explorer/pricing-reserved-capacity

Architecture & Design Patterns

TopicURL
Design ADX regional DR and replication solutionshttps://learn.microsoft.com/en-us/azure/data-explorer/business-continuity-create-solution
Use follower databases for cross-cluster ADX accesshttps://learn.microsoft.com/en-us/azure/data-explorer/follower
Choose multitenant architectures for Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/multi-tenant

Limits & Quotas

TopicURL
Understand automatic stop behavior for inactive clustershttps://learn.microsoft.com/en-us/azure/data-explorer/auto-stop-clusters
Apply Event Grid ingestion file size limits in Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/create-event-grid-connection
Delete and recover Azure Data Explorer clusters safelyhttps://learn.microsoft.com/en-us/azure/data-explorer/delete-cluster
Understand invalid data behavior during ADX ingestionhttps://learn.microsoft.com/en-us/azure/data-explorer/ingest-invalid-data
Supported data and compression formats for Azure Data Explorer ingestionhttps://learn.microsoft.com/en-us/azure/data-explorer/ingestion-supported-formats
Use Azure Data Explorer free cluster limitshttps://learn.microsoft.com/en-us/azure/data-explorer/start-for-free
Upgrade free Azure Data Explorer clusters and remove limitshttps://learn.microsoft.com/en-us/azure/data-explorer/start-for-free-upgrade

Security

TopicURL
Programmatically add Azure Data Explorer cluster principalshttps://learn.microsoft.com/en-us/azure/data-explorer/add-cluster-principal
Programmatically add Azure Data Explorer database principalshttps://learn.microsoft.com/en-us/azure/data-explorer/add-database-principal
Enable disk encryption for Azure Data Explorer clustershttps://learn.microsoft.com/en-us/azure/data-explorer/cluster-encryption-disk
Configure encryption options for Azure Data Explorer clustershttps://learn.microsoft.com/en-us/azure/data-explorer/cluster-encryption-overview
Configure managed identities on Azure Data Explorer clustershttps://learn.microsoft.com/en-us/azure/data-explorer/configure-managed-identities-cluster
Configure cross-tenant access for Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/cross-tenant-query-and-commands
Configure customer-managed keys for Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/customer-managed-keys
Purge personal data from Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/data-purge-portal
Authenticate external tables with managed identitieshttps://learn.microsoft.com/en-us/azure/data-explorer/external-tables-managed-identities
Ingest data using managed identity authenticationhttps://learn.microsoft.com/en-us/azure/data-explorer/ingest-data-managed-identity
Configure and manage Azure Data Explorer cluster lockshttps://learn.microsoft.com/en-us/azure/data-explorer/manage-cluster-locks
Configure Azure Data Explorer cluster RBAC permissionshttps://learn.microsoft.com/en-us/azure/data-explorer/manage-cluster-permissions
Configure database and table RBAC in Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/manage-database-permissions
Use managed identities with Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/managed-identities-overview
Apply built-in Azure Policy definitions to ADXhttps://learn.microsoft.com/en-us/azure/data-explorer/policy-reference
Securely connect private-endpoint clusters to Power BIhttps://learn.microsoft.com/en-us/azure/data-explorer/power-bi-private-endpoint
Create and authorize Microsoft Entra apps for Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/provision-entra-id-app
Enable conditional access policies for Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/security-conditional-access
Apply Azure Policy compliance controls to Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/security-controls-policy
Configure managed private endpoints for Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/security-network-managed-private-endpoint-create
Plan network security for Azure Data Explorer clustershttps://learn.microsoft.com/en-us/azure/data-explorer/security-network-overview
Secure Azure Data Explorer with private endpointshttps://learn.microsoft.com/en-us/azure/data-explorer/security-network-private-endpoint
Restrict outbound access from Azure Data Explorer clustershttps://learn.microsoft.com/en-us/azure/data-explorer/security-network-restrict-outbound-access
Control public network access to Data Explorer clustershttps://learn.microsoft.com/en-us/azure/data-explorer/security-network-restrict-public-access

Configuration

TopicURL
Clone Azure Data Explorer database schemas with management commandshttps://learn.microsoft.com/en-us/azure/data-explorer/clone-database-schema
Use KQL database scripts in ARM deploymentshttps://learn.microsoft.com/en-us/azure/data-explorer/database-script
Programmatically create Azure Data Explorer database and table policieshttps://learn.microsoft.com/en-us/azure/data-explorer/database-table-policies
Create cross-tenant Event Hubs data connections for Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/ingest-data-cross-tenant
Install and run the ADX Kusto emulatorhttps://learn.microsoft.com/en-us/azure/data-explorer/kusto-emulator-install
Manage language extension plugins in Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/language-extensions
Reference metrics and logs for Azure Data Explorer monitoringhttps://learn.microsoft.com/en-us/azure/data-explorer/monitor-data-explorer-reference
Synchronize ADX schema with Sync Kusto toolhttps://learn.microsoft.com/en-us/azure/data-explorer/sync-kusto
Use T-SQL queries against Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/t-sql
Customize Azure Data Explorer web UI environment settingshttps://learn.microsoft.com/en-us/azure/data-explorer/web-customize-settings
Configure cloud sync for Azure Data Explorer web UI profileshttps://learn.microsoft.com/en-us/azure/data-explorer/web-sync
Use Azure Data Explorer web UI query keyboard shortcutshttps://learn.microsoft.com/en-us/azure/data-explorer/web-ui-query-keyboard-shortcuts

Integrations & Coding Patterns

TopicURL
Manage ADX with Azure PowerShell Kusto cmdletshttps://learn.microsoft.com/en-us/azure/data-explorer/azure-powershell
Connect common SQL tools to Azure Data Explorer via emulationhttps://learn.microsoft.com/en-us/azure/data-explorer/connect-common-apps
Configure JDBC connectivity to Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/connect-jdbc
Set up ODBC connections to Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/connect-odbc
Query Azure Storage external tables from Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/external-azure-storage-tables-query
Use ADX connector in Power Automate flowshttps://learn.microsoft.com/en-us/azure/data-explorer/flow
Automate ADX queries with Power Automate exampleshttps://learn.microsoft.com/en-us/azure/data-explorer/flow-usage
Configure Grafana integration with Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/grafana
Connect Splunk Enterprise to Azure Data Explorer for ingestionhttps://learn.microsoft.com/en-us/azure/data-explorer/ingest-data-splunk
Ingest data from Splunk Universal Forwarder into Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/ingest-data-splunk-uf
Configure Telegraf Azure Data Explorer output pluginhttps://learn.microsoft.com/en-us/azure/data-explorer/ingest-data-telegraf
Use ADX input/​output bindings in Azure Functionshttps://learn.microsoft.com/en-us/azure/data-explorer/integrate-azure-functions
Integrate MCP servers with Azure Data Explorer clustershttps://learn.microsoft.com/en-us/azure/data-explorer/integrate-mcp-servers
Configure K2Bridge to use Azure Data Explorer in Kibanahttps://learn.microsoft.com/en-us/azure/data-explorer/k2bridge
Query ADX from Jupyter using Kqlmagichttps://learn.microsoft.com/en-us/azure/data-explorer/kqlmagic
Query ADX as a linked server from SQL Serverhttps://learn.microsoft.com/en-us/azure/data-explorer/linked-server
Run ADX queries via Logic Apps connectorhttps://learn.microsoft.com/en-us/azure/data-explorer/logic-apps
Configure OpenTelemetry collector to ingest into Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/open-telemetry-connector
Build Power Apps that query Azure Data Explorer via connectorhttps://learn.microsoft.com/en-us/azure/data-explorer/power-apps-connector
Integrate Azure Data Explorer with Microsoft Purviewhttps://learn.microsoft.com/en-us/azure/data-explorer/purview
Query Azure Data Explorer using the Python data client libraryhttps://learn.microsoft.com/en-us/azure/data-explorer/python-query-data
Query Azure Data Explorer from MATLAB using authorization tokenshttps://learn.microsoft.com/en-us/azure/data-explorer/query-matlab
Run cross-service queries between Azure Data Explorer and Azure Monitorhttps://learn.microsoft.com/en-us/azure/data-explorer/query-monitor-data
Use Redash native connector with Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/redash
Use Serilog sink to stream logs into Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/serilog-sink
Set up Sisense integration with Azure Data Explorerhttps://learn.microsoft.com/en-us/azure/data-explorer/sisense
Run KQL queries and stored functions over TDS from SQL clientshttps://learn.microsoft.com/en-us/azure/data-explorer/sql-kql-queries-and-stored-functions
Connect to Azure Data Explorer using SQL Server emulation (TDS endpoint)https://learn.microsoft.com/en-us/azure/data-explorer/sql-server-emulation-overview
Connect Azure Data Explorer to Tableau via ODBChttps://learn.microsoft.com/en-us/azure/data-explorer/tableau
Debug KQL inline Python plugin code using Visual Studio Codehttps://learn.microsoft.com/en-us/kusto/debug-inline-python?view=microsoft-fabric

Deployment

TopicURL
Automate provisioning of Azure Data Explorer environmentshttps://learn.microsoft.com/en-us/azure/data-explorer/automated-deploy-overview
Use Azure DevOps pipelines for Azure Data Explorer schema deploymenthttps://learn.microsoft.com/en-us/azure/data-explorer/devops
Migrate Azure Data Explorer clusters to availability zoneshttps://learn.microsoft.com/en-us/azure/data-explorer/migrate-cluster-to-multiple-availability-zone
Migrate Azure Data Explorer VNet injection to private endpointshttps://learn.microsoft.com/en-us/azure/data-explorer/security-network-migrate-vnet-to-private-endpoint