azure-stream-analytics

Name: azure-stream-analytics
Author: microsoftdocs

github.com/microsoftdocsData & databases796167 installsUpdated 3d ago

About azure-stream-analytics

A reference skill for agents working with Azure Stream Analytics, pairing local quick-reference material with remote documentation retrieval. It covers job design, troubleshooting, security, integrations, and deployment.

Key features

01Job error and performance diagnosis
02Query and job design guidance
03Scaling and architecture planning
04Security configuration references
05Integration and coding patterns

Use cases

01Finding input, output, or query errors
02Improving job performance and parallelization
03Planning job scaling and deployment

MCP support

The skill can retrieve remote documentation through mcp_microsoftdocs tools; its instructions describe fetch_webpage as a fallback.

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/microsoftdocs/agent-skills --skill azure-stream-analytics

After installing, type/azure-stream-analyticsin Claude Code to confirm it loaded.

Details

From the project README

Azure Stream Analytics Skill

This skill provides expert guidance for Azure Stream Analytics. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.

Category Index

Category	Lines	Description
Troubleshooting	L37-L58	Diagnosing and fixing Stream Analytics job errors (config, data, internal/external), performance issues, and input/output/query problems using logs and job diagrams (logical/physical).
Best Practices	L59-L73	Best practices for Stream Analytics job design, query patterns, performance tuning, scaling, reliability, time handling, geospatial logic, ML/Cosmos/SQL outputs, and alerting.
Decision Making	L74-L82	Guidance on choosing Stream Analytics tools and services, migrating from Visual Studio/.NET UDFs, and configuring autoscale and real-time processing options.
Architecture & Design Patterns	L83-L88	Designing resilient, geo-redundant Stream Analytics topologies and scaling jobs using Streaming Units, input/output partitioning, and performance tuning patterns.
Limits & Quotas	L89-L96	Limits, sizing, and performance of Stream Analytics: Event Hubs output size caps, streaming unit/cluster scaling, and IoT Edge-specific limits and support.
Security	L97-L117	Securing Stream Analytics jobs: managed identities for inputs/outputs (Event Hubs, SQL, Synapse, Cosmos, Blob, Service Bus, Power BI), VNet/private endpoints, data protection, and Azure Policy compliance.
Configuration	L118-L149	Configuring Stream Analytics jobs: inputs, outputs (Cosmos DB, SQL, Event Hubs, Kafka, Power BI, Delta Lake, etc.), autoscale, ordering, error handling, monitoring, and compatibility.
Integrations & Coding Patterns	L150-L166	Patterns and code for integrating Stream Analytics with Kafka, SQL, Azure ML, UDFs (C#/JS), anomaly detection, schema registry, and advanced scenarios like HFT and .NET job management
Deployment	L167-L180	Automating deployment, migration, and lifecycle (start/stop/delete) of Stream Analytics jobs and clusters using ARM/Bicep, GitHub Actions, Azure DevOps, REST, and edge/Stack Hub tools

Troubleshooting

Topic	URL
Resolve Stream Analytics configuration error codes	https://learn.microsoft.com/en-us/azure/stream-analytics/configuration-error-codes
Resolve Stream Analytics data error codes	https://learn.microsoft.com/en-us/azure/stream-analytics/data-error-codes
Resolve data errors in Azure Stream Analytics jobs	https://learn.microsoft.com/en-us/azure/stream-analytics/data-errors
Debug Stream Analytics queries locally with Visual Studio job diagram	https://learn.microsoft.com/en-us/azure/stream-analytics/debug-locally-using-job-diagram
Debug Stream Analytics queries locally with VS Code job diagram	https://learn.microsoft.com/en-us/azure/stream-analytics/debug-locally-using-job-diagram-vs-code
Debug user-defined functions in Azure Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/debug-user-defined-functions
Resolve Stream Analytics external availability error codes	https://learn.microsoft.com/en-us/azure/stream-analytics/external-availability-error-codes
Resolve Stream Analytics external error codes	https://learn.microsoft.com/en-us/azure/stream-analytics/external-error-codes
Resolve Stream Analytics internal error codes	https://learn.microsoft.com/en-us/azure/stream-analytics/internal-error-codes
Use job diagram metrics to troubleshoot Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/job-diagram-with-metrics
Diagnose Azure Stream Analytics job performance	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-job-analysis-with-metric-dimensions
Troubleshoot Stream Analytics jobs with resource logs	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-job-diagnostic-logs
Debug Stream Analytics jobs with logical job diagram	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-job-logical-diagram-with-metrics
Use physical job diagram metrics to debug Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-job-physical-diagram-with-metrics
Monitor and troubleshoot Azure Stream Analytics jobs	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-monitoring
Diagnose and fix Azure Stream Analytics input issues	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-troubleshoot-input
Troubleshoot Azure Stream Analytics output connection problems	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-troubleshoot-output
Troubleshoot Azure Stream Analytics query issues	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-troubleshoot-query

Best Practices

Topic	URL
Develop and debug Azure Stream Analytics jobs locally	https://learn.microsoft.com/en-us/azure/stream-analytics/develop-locally
Build geofencing and geospatial aggregation with Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/geospatial-scenarios
Implement input validation patterns for Stream Analytics resiliency	https://learn.microsoft.com/en-us/azure/stream-analytics/input-validation
Optimize Stream Analytics query performance with Job Simulation	https://learn.microsoft.com/en-us/azure/stream-analytics/optimize-query-using-job-diagram-simulator
Optimize non-parallelizable Stream Analytics jobs with repartitioning	https://learn.microsoft.com/en-us/azure/stream-analytics/repartition
Improve Azure Stream Analytics job reliability and upgrades	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-job-reliability
Optimize Azure Stream Analytics with query parallelization	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-parallelization
Optimize Azure SQL Database output performance for Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-sql-output-perf
Apply common query patterns in Azure Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-stream-analytics-query-patterns
Implement configurable threshold-based alerting in Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-threshold-based-rules
Design time handling and lateness in Azure Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-time-handling

Decision Making

Topic	URL
Choose Azure Stream Analytics portal vs VS Code tools	https://learn.microsoft.com/en-us/azure/stream-analytics/feature-comparison
Migrate Stream Analytics projects from Visual Studio to VS Code	https://learn.microsoft.com/en-us/azure/stream-analytics/migrate-to-vscode
Choose and configure autoscale for Stream Analytics SUs	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-autoscale
Migrate from .NET UDFs to JavaScript in Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-edge-csharp-udf-methods
Choose Azure real-time and stream processing services	https://learn.microsoft.com/en-us/azure/stream-analytics/streaming-technologies

Architecture & Design Patterns

Topic	URL
Design geo-redundant Azure Stream Analytics job architectures	https://learn.microsoft.com/en-us/azure/stream-analytics/geo-redundancy
Scale Azure Stream Analytics jobs with SUs and partitioning	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-scale-jobs

Limits & Quotas

Topic	URL
Use Event Hubs as Stream Analytics output with size limits	https://learn.microsoft.com/en-us/azure/stream-analytics/event-hubs-output
Resize Azure Stream Analytics clusters by streaming units	https://learn.microsoft.com/en-us/azure/stream-analytics/scale-cluster
Understand Azure Stream Analytics on IoT Edge limits and support	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-edge
Understand and tune Azure Stream Analytics streaming units	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-streaming-unit-consumption

Security

Topic	URL
Configure managed identity for Azure Data Explorer outputs	https://learn.microsoft.com/en-us/azure/stream-analytics/azure-data-explorer-managed-identity
Configure managed identity auth for Stream Analytics Blob output	https://learn.microsoft.com/en-us/azure/stream-analytics/blob-output-managed-identity
Securely connect Stream Analytics jobs to Azure VNets	https://learn.microsoft.com/en-us/azure/stream-analytics/connect-job-to-vnet
Use managed identities for Cosmos DB outputs in Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/cosmos-db-managed-identity
Configure data protection for Azure Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/data-protection
Access Event Hubs from Stream Analytics with managed identities	https://learn.microsoft.com/en-us/azure/stream-analytics/event-hubs-managed-identity
Apply built-in Azure Policy definitions to Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/policy-reference
Set up managed identity authentication for Stream Analytics Power BI output	https://learn.microsoft.com/en-us/azure/stream-analytics/powerbi-output-managed-identity
Configure Stream Analytics cluster managed private endpoints	https://learn.microsoft.com/en-us/azure/stream-analytics/private-endpoints
Secure Azure Stream Analytics jobs in virtual networks	https://learn.microsoft.com/en-us/azure/stream-analytics/run-job-in-virtual-network
Apply Azure Policy compliance controls to Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/security-controls-policy
Send Stream Analytics outputs to Service Bus with managed identity	https://learn.microsoft.com/en-us/azure/stream-analytics/service-bus-managed-identity
Use managed identities from Stream Analytics to Azure SQL and Synapse	https://learn.microsoft.com/en-us/azure/stream-analytics/sql-database-output-managed-identity
Configure Kafka input and security for Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-kafka-input
Rotate input and output credentials for Azure Stream Analytics jobs	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-login-credentials-inputs-outputs
Use managed identities with Azure Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-managed-identities-overview
Configure user-assigned managed identities for Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-user-assigned-managed-identity-overview

Configuration

Topic	URL
Configure Azure Cosmos DB as Stream Analytics output	https://learn.microsoft.com/en-us/azure/stream-analytics/azure-cosmos-db-output
Configure Azure Data Explorer as Stream Analytics output	https://learn.microsoft.com/en-us/azure/stream-analytics/azure-database-explorer-output
Connect Azure Stream Analytics outputs to Azure Functions	https://learn.microsoft.com/en-us/azure/stream-analytics/azure-functions-output
Configure Azure Synapse Analytics dedicated SQL pool as Stream Analytics output	https://learn.microsoft.com/en-us/azure/stream-analytics/azure-synapse-analytics-output
Configure Blob Storage and Data Lake Gen2 outputs for Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/blob-storage-azure-data-lake-gen2-output
Configure Stream Analytics autoscale settings via CI/CD tool	https://learn.microsoft.com/en-us/azure/stream-analytics/cicd-autoscale
Configure event ordering policies in Azure Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/event-ordering
Reference for Stream Analytics JobConfig.json fields in VS Code	https://learn.microsoft.com/en-us/azure/stream-analytics/job-config-json
Configure Kafka output for Azure Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/kafka-output
Configure monitoring for Azure Stream Analytics with Azure Monitor	https://learn.microsoft.com/en-us/azure/stream-analytics/monitor-azure-stream-analytics
Reference for Azure Stream Analytics monitoring metrics and logs	https://learn.microsoft.com/en-us/azure/stream-analytics/monitor-azure-stream-analytics-reference
Configure Azure Database for PostgreSQL as Stream Analytics output	https://learn.microsoft.com/en-us/azure/stream-analytics/postgresql-database-output
Configure Power BI as an Azure Stream Analytics output	https://learn.microsoft.com/en-us/azure/stream-analytics/power-bi-output
Configure Service Bus queues as Stream Analytics output	https://learn.microsoft.com/en-us/azure/stream-analytics/service-bus-queues-output
Configure Service Bus topics as Stream Analytics output	https://learn.microsoft.com/en-us/azure/stream-analytics/service-bus-topics-output
Configure Azure SQL Database as Stream Analytics output	https://learn.microsoft.com/en-us/azure/stream-analytics/sql-database-output
Configure Azure SQL Database as Stream Analytics output	https://learn.microsoft.com/en-us/azure/stream-analytics/sql-db-table
Configure compatibility levels for Azure Stream Analytics jobs	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-compatibility-level
Configure custom blob output partitioning in Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-custom-path-patterns-blob-storage-output
Configure input sources for Azure Stream Analytics jobs	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-define-inputs
Configure Azure Cosmos DB output for Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-documentdb-output
Monitor and manage Stream Analytics jobs with PowerShell	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-monitor-and-manage-jobs-use-powershell
Programmatically enable and configure Stream Analytics job monitoring	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-monitor-jobs
Configure output error handling policies in Azure Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-output-error-policy
Configure Protobuf input deserialization in Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-parsing-protobuf
Set up Azure Monitor alerts for Stream Analytics jobs	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-set-up-alerts
Set up Azure Table storage output for Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/table-storage-output
Configure Azure Stream Analytics output to Delta Lake	https://learn.microsoft.com/en-us/azure/stream-analytics/write-to-delta-lake

Integrations & Coding Patterns

Topic	URL
Use Confluent Cloud Kafka as Stream Analytics input	https://learn.microsoft.com/en-us/azure/stream-analytics/confluent-kafka-input
Send Stream Analytics output to Confluent Cloud Kafka	https://learn.microsoft.com/en-us/azure/stream-analytics/confluent-kafka-output
Integrate Azure Machine Learning models as Stream Analytics UDFs	https://learn.microsoft.com/en-us/azure/stream-analytics/machine-learning-udf
Implement SQL UPDATE/UPSERT via Azure Functions from Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/sql-database-upsert
Configure Azure SQL Database as reference input	https://learn.microsoft.com/en-us/azure/stream-analytics/sql-reference-data
Manage Stream Analytics jobs with .NET Management SDK	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-dotnet-management-sdk
Write C# user-defined functions for Stream Analytics in Visual Studio	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-edge-csharp-udf
Implement high-frequency trading with Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-high-frequency-trading
Create JavaScript user-defined aggregates in Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-javascript-user-defined-aggregates
Implement JavaScript UDFs in Azure Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-javascript-user-defined-functions
Use built-in ML anomaly detection in Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-machine-learning-anomaly-detection
Parse JSON, Avro, and complex data in Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-parsing-json
Integrate Azure Stream Analytics with Event Hubs Schema Registry	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-schema-registry-integration

Deployment

Topic	URL
Generate and deploy Stream Analytics jobs with Bicep	https://learn.microsoft.com/en-us/azure/stream-analytics/cicd-deploy-with-bicep
Deploy Stream Analytics jobs using GitHub Actions workflows	https://learn.microsoft.com/en-us/azure/stream-analytics/cicd-github-actions
Migrate Azure Stream Analytics jobs across regions	https://learn.microsoft.com/en-us/azure/stream-analytics/move-across-regions
Move Azure Stream Analytics clusters across regions	https://learn.microsoft.com/en-us/azure/stream-analytics/move-cluster
Deploy Stream Analytics edge jobs to Azure Stack Hub	https://learn.microsoft.com/en-us/azure/stream-analytics/on-azure-stack
Export Stream Analytics jobs as ARM templates	https://learn.microsoft.com/en-us/azure/stream-analytics/resource-manager-export
Set up Azure DevOps CI/CD for Stream Analytics	https://learn.microsoft.com/en-us/azure/stream-analytics/set-up-cicd-pipeline
Start Azure Stream Analytics jobs via portal, PowerShell, and Visual Studio	https://learn.microsoft.com/en-us/azure/stream-analytics/start-job
Implement CI/CD for Stream Analytics on IoT Edge via REST	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-cicd-api
Stop and delete Azure Stream Analytics jobs safely	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-clean-up-your-job
Use Stream Analytics CI/CD NuGet package with MSBuild	https://learn.microsoft.com/en-us/azure/stream-analytics/stream-analytics-tools-for-visual-studio-cicd

Comments

Markdown supported

Details

Author: microsoftdocs
Repository: microsoftdocs/agent-skills
Category: Data & databases
Installs: 167
GitHub stars: 796

Report

More skills

All skills

hyperframes-core

github.com/heygen-com

930.6k

The HyperFrames composition contract — build one renderable project. Use for composition structure, the `data-*` timing attributes, `class="clip"`, tracks, sub-compositions, variables, framework-owned media playback, deterministic-render rules, and validation. Also covers Tailwind projects and the STORYBOARD.md / SCRIPT.md plan formats. Read before writing composition HTML.

lark-base

open.feishu.cn

823.2k

Operate on Feishu Base: create tables, fields, records, and views; handle statistics, formulas/lookups, forms, dashboards, app mode (BaseApp/AppMode pages and components), Workspace directories, workflows, role permissions, and the template center (Base template categories, lists, and search). Use when encountering Base/multidimensional tables/bitable, BaseApp/AppMode, or /base/ or /app/ links. Do not use lark-apps for BaseApp; route file import/export to lark-drive and authentication/authorization to lark-shared.

lark-sheets

open.feishu.cn

821.8k

Feishu Spreadsheets: create and operate spreadsheets. Supports worksheets and row/column structures (add/delete/merge/size/hide/freeze/group), cell read/write (values/formulas/styles/comments/cell images), range copy/move/sort/fill, find and replace, bulk updates, and creating and maintaining objects such as charts, pivot tables, conditional formatting, filters and filter views, dropdown lists, sparklines, and floating images. Also supports formula validation, restoring historical versions, and importing/exporting local Excel/CSV files and Feishu spreadsheets. Use when users need to create or edit spreadsheets, summarize and visualize data, format spreadsheets, calculate formulas (including migrating Excel formulas), or build financial models (DCF, three statements, budgets, Sensitivity, etc.). For multidimensional tables (Base/bitable), use lark-base. If users want to search for spreadsheet files in cloud storage (Drive/cloud storage) by name or keyword, use lark-drive's drive +search to locate resources first. When users provide a doubao.com /sheets/ URL/token, use this skill directly; do not fall back to WebFetch because the domain is not Feishu. Routing is based on the URL path pattern and token, not the domain.

remotion-best-practices

github.com/remotion-dev

701.4k

Best practices and domain knowledge for building videos programmatically with Remotion (videos in React/TypeScript, rendered to MP4). Use whenever writing or editing Remotion code — scaffolding a video project, animating with interpolate/spring over useCurrentFrame(), sequencing scenes and transitions, captions/subtitles, audio, GIFs/Lottie/3D, charts, visual effects, dynamic duration via calculateMetadata, or rendering. Consult before reaching for a Remotion API, since its components and props evolve (e.g. @remotion/media).