azure-content-understanding

Azure Content Understanding in Foundry Tools Skill

This skill provides expert guidance for Azure Content Understanding in Foundry Tools. Covers troubleshooting, best practices, decision making, architecture & design patterns, limits & quotas, security, configuration, and integrations & coding patterns. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

• Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
• Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.

Category Index

Category	Lines	Description
Troubleshooting	L36-L40	Using diagnostics from the Content Understanding REST API to investigate failures, interpret error codes, and troubleshoot processing or configuration issues.
Best Practices	L41-L46	Improving Content Understanding accuracy using layout, labels, and feedback, plus using confidence scores and grounding to validate and refine document analysis results.
Decision Making	L47-L55	Guidance on choosing Azure AI tools, model deployments, and Studio vs Foundry, plus migration from preview to GA and estimating/optimizing Content Understanding costs.
Architecture & Design Patterns	L56-L62	Guidance on when to use agentic mode, how to design RAG-based document solutions, and how to build RPA workflows using Azure Content Understanding.
Limits & Quotas	L63-L68	Guidance on safe use of synchronous Content Understanding calls and detailed quotas/limits (throughput, payload sizes, concurrency) for planning and troubleshooting usage.
Security	L69-L74	Configuring security for Content Understanding: setting guardrails on analyzer outputs, securing analyzers and data, access control, and safe handling of sensitive content.
Configuration	L75-L88	Configuring and customizing Content Understanding analyzers, classifiers, workflows, and audiovisual/Markdown outputs, including creating, copying, and managing custom analyzers and Foundry resources.
Integrations & Coding Patterns	L89-L94	Patterns and code samples for calling Content Understanding via REST/SDKs, integrating with Microsoft Agent Framework/LangChain, and implementing agentic workflows.

Troubleshooting

Topic	URL
Use diagnostics from Content Understanding REST API	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/how-to/retrieve-diagnostics

Best Practices

Topic	URL
Apply best practices for Content Understanding accuracy	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/concepts/best-practices
Improve document analysis with confidence and grounding	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/document/analyzer-improvement

Decision Making

Topic	URL
Choose Azure AI tools for document processing	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/choosing-right-ai-tool
Choose model deployments for Content Understanding analyzers	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/concepts/models-deployments
Choose between Content Understanding Studio and Foundry	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/foundry-vs-content-understanding-studio
Migrate Content Understanding from preview to GA	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/how-to/migration-preview-to-ga
Estimate and optimize Azure Content Understanding costs	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/pricing-explainer

Architecture & Design Patterns

Topic	URL
Decide when to use agentic mode for documents	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/concepts/agentic-mode
Design a RAG solution with Content Understanding	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/tutorial/build-rag-solution
Design RPA workflows using Content Understanding	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/tutorial/robotic-process-automation

Limits & Quotas

Topic	URL
Use synchronous Content Understanding operations safely	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/quickstart/use-synchronous-rest-api
Reference quotas and limits for Content Understanding	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/service-limits

Security

Topic	URL
Configure guardrails for Content Understanding results	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/concepts/guardrails
Secure Content Understanding analyzers and data	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/concepts/secure-communications

Configuration

Topic	URL
Configure and customize Content Understanding analyzers	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/concepts/analyzer-reference
Configure Content Understanding classifier and splitting	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/concepts/classifier
Interpret Content Understanding Markdown document output	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/document/markdown
Configure classification and routing workflows in Content Understanding	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/how-to/classification-content-understanding-studio
Copy custom analyzers within and across resources	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/how-to/copy-analyzers
Create and manage Microsoft Foundry resources	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/how-to/create-multi-service-resource
Build and refine custom analyzers in Studio	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/how-to/customize-analyzer-content-understanding-studio
Create custom analyzers via Content Understanding REST API	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/tutorial/create-custom-analyzer
Configure audiovisual analysis and structured output	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/video/elements
Use Markdown output for audiovisual content	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/video/markdown

Integrations & Coding Patterns

Topic	URL
Integrate Content Understanding with Microsoft Agent Framework	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/integrations/agent-framework
Use Content Understanding as a LangChain document loader	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/integrations/langchain
Call Content Understanding REST APIs and SDKs	https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/quickstart/use-rest-api