azure-speech

Name: azure-speech
Author: microsoftdocs

github.com/microsoftdocsDevelopment796241 installsUpdated 3d ago

About azure-speech

azure-speech is a guidance skill for developers and operators working with Azure Speech in Foundry Tools. It brings together local references and remotely fetched documentation on speech features, security, integration, and deployment.

Key features

01Speech troubleshooting references
02Audio and transcription best practices
03API selection and migration guidance
04Security and configuration references
05Integration and deployment patterns

Use cases

01Resolving Speech SDK or container issues
02Preparing audio for batch transcription
03Planning REST API or feature migrations
04Deploying Speech services in containers

MCP support

The skill can retrieve Microsoft documentation using mcp_microsoftdocs:microsoft_docs_fetch, with webpage fetching as a fallback.

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/microsoftdocs/agent-skills --skill azure-speech

After installing, type/azure-speechin Claude Code to confirm it loaded.

Details

From the project README

Azure Speech in Foundry Tools Skill

This skill provides expert guidance for Azure Speech in Foundry Tools. Covers troubleshooting, best practices, decision making, limits & quotas, security, configuration, integrations & coding patterns, and deployment. It combines local quick-reference content with remote documentation fetching capabilities.

How to Use This Skill

IMPORTANT for Agent: Use the Category Index below to locate relevant sections. For categories with line ranges (e.g., L35-L120), use read_file with the specified lines. For categories with file links (e.g., [security.md](security.md)), use read_file on the linked reference file

IMPORTANT for Agent: If metadata.generated_at is more than 3 months old, suggest the user pull the latest version from the repository. If mcp_microsoftdocs tools are not available, suggest the user install it: Installation Guide

This skill requires network access to fetch documentation content:

Preferred: Use mcp_microsoftdocs:microsoft_docs_fetch with query string from=learn-agent-skill. Returns Markdown.
Fallback: Use fetch_webpage with query string from=learn-agent-skill&accept=text/markdown. Returns Markdown.

Category Index

Category	Lines	Description
Troubleshooting	L36-L44	Diagnosing and fixing common Azure Speech issues in Foundry (TTS/STT errors, SDK and container problems, deployment failures, and how to collect session/transcription IDs for support).
Best Practices	L45-L62	Best practices for audio/video prep, transcription quality, custom voice/avatars, latency and memory tuning, keyword/phrase accuracy, device design, reliability, and backup/recovery for Azure Speech.
Decision Making	L63-L78	Guides for choosing APIs, telephony options, and evaluating devices/voice types, plus step-by-step migrations between Speech/voice REST versions and from retired features to newer services.
Limits & Quotas	L79-L86	Quotas, limits, and lifecycle rules for Azure Speech: custom speech/voice models and endpoints, supported languages/voices, and capacity constraints for deploying and using Speech services.
Security	L87-L100	Securing Azure AI Speech: auth (Entra, RBAC), network isolation (VNet, Private Link, sovereign clouds), encryption/BYOK/BYOS, compliance/consent, and secure custom/voice/avatar model integration.
Configuration	L101-L134	Configuring Azure Speech/Voice features: recognition, TTS, avatars, containers, logging, storage, phonetics/SSML, audio inputs, diagnostics, and Voice Live/CLI runtime and output options.
Integrations & Coding Patterns	L135-L168	Patterns and code samples for integrating Azure Speech (STT, TTS, avatars, translation) with telephony, Voice Live, REST/SDK APIs, OpenAI, automation tools, and real-time agent workflows.
Deployment	L169-L179	Deploying and running Azure Speech services (STT, TTS, language ID) via containers, Kubernetes/Helm, and batch APIs, including custom models and on-premises setups.

Troubleshooting

Topic	URL
Troubleshoot common Azure text-to-speech issues	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/faq-tts
Retrieve Speech to text session and transcription IDs for support	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-get-speech-session-id
Resolve common Azure Speech in Foundry issues	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/known-issues
Troubleshoot Azure Speech containers deployment issues	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-faq
Diagnose and fix common Azure Speech SDK issues	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/troubleshooting

Best Practices

Topic	URL
Prepare and locate audio data for batch transcription	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/batch-transcription-audio-data
Create high-quality human-labeled speech transcriptions	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-custom-speech-human-labeled-transcriptions
Prepare training data for professional custom voice	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-custom-voice-training-data
Apply best practices to reduce Speech synthesis latency	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-lower-speech-synthesis-latency
Track and manage Azure Speech SDK memory usage	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-track-speech-sdk-memory-usage
Handle interrupted responses in Voice Live chat history	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-auto-truncation
Evaluate Voice Live agents with Foundry harness	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-evaluate
Use phrase lists to improve Azure Speech accuracy	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/improve-accuracy-phrase-list
Apply keyword recognition design and accuracy guidelines	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/keyword-recognition-guidelines
Mitigate Azure AI Speech SDK CRL compatibility issue	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-to-sdk-1-48-2
Record high-quality samples for custom voice training	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/record-custom-voice-samples
Back up and recover custom Speech and Voice resources	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/resiliency-and-recovery-plan
Design microphone arrays optimized for Speech SDK	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-sdk-microphone
Prepare high-quality video samples for custom avatars	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/text-to-speech-avatar/custom-avatar-record-video-samples

Decision Making

Topic	URL
Evaluate custom voice lite before professional voice	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/custom-neural-voice-lite
Evaluate device suitability for embedded speech models	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/embedded-speech-performance-evaluations
Choose MAI-Transcribe-2-Streaming API option	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/mai-transcribe-2-streaming
Migrate Speech to text REST API from v3.2 to 2024-11-15	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-2024-11-15
Migrate Speech to text REST API 2024-11-15 to 2025-10-15	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-2025-10-15
Migrate from retired Speech intent recognition to Language or OpenAI	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-intent-recognition
Migrate from Long Audio API to Batch synthesis	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-to-batch-synthesis
Migrate from v3 text-to-speech to custom voice REST API	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-to-custom-voice-api
Migrate Speech-to-text REST from v3.0 to v3.1	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-v3-0-to-v3-1
Migrate Speech to text REST API v3.1 to v3.2	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/migrate-v3-1-to-v3-2
Evaluate Voice Live API for real-time agents	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live
Choose telephony integration for Foundry voice agents	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-telephony

Limits & Quotas

Topic	URL
Manage custom speech model and endpoint lifecycle	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-custom-speech-model-and-endpoint-lifecycle
Check Azure Speech language and voice availability	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/language-support
Custom voice endpoint limits for Speech service	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/professional-voice-deploy-endpoint
Reference quotas and limits for Azure Speech	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-services-quotas-and-limits

Security

Topic	URL
Configure BYOS storage for Azure Speech resources	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/bring-your-own-storage-speech-resource
Integrate custom models with Voice Live BYOM	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-bring-your-own-model
Configure Microsoft Entra auth for Azure AI Speech	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-configure-azure-ad-auth
Configure consent and compliance for personal voice	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/personal-voice-create-consent
Assign Azure RBAC roles for Speech resources	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/role-based-access-control
Configure Speech service in Azure sovereign clouds	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/sovereign-clouds
Manage Speech service data-at-rest encryption and keys	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-encryption-of-data-at-rest
Secure Speech service with Virtual Network service endpoints	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-service-vnet-service-endpoint
Secure Azure AI Speech with Private Link endpoints	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-services-private-link
Use content credentials for Azure avatar videos	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/text-to-speech-avatar/content-credentials

Configuration

Topic	URL
Configure Batch synthesis properties for text-to-speech	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/batch-synthesis-properties
Check status and retrieve batch transcription results	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/batch-transcription-get
Configure BYOS storage for Speech to text	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/bring-your-own-storage-speech-resource-speech-to-text
Configure language ID and diarization in Azure Speech	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/configure-language-identification-diarization
Define UPS phonetic pronunciations for Speech to text	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/customize-pronunciation
Configure OpenSSL on Linux for Azure Speech SDK	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-configure-openssl-linux
Control and monitor Speech SDK service connections	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-control-connections
Configure post-processing options for Azure speech recognition	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-post-processing
Configure real-time speech recognition with Azure Speech	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-recognize-speech
Select and configure audio input devices in Speech SDK	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-select-audio-input-devices
Use visemes for facial animation with Speech service	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-speech-synthesis-viseme
Configure Speech SDK audio input streams	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-use-audio-input-streams
Configure compressed audio input for Speech SDK and CLI	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-use-codec-compressed-audio-input-streams
Enable and configure Speech SDK diagnostic logging	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-use-logging
Configure interim responses for Voice Live tools	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-interim-response
Configure OpenTelemetry tracing for Voice Live SDK	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-telemetry
Configure audio and transcription logging for Speech recognition	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/logging-audio-transcription
Upload and validate training datasets for professional voice	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/professional-voice-create-training-set
Configure Azure Speech text-to-speech avatar options	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/quickstarts/get-started-text-to-speech-avatar
Use correct Azure Speech regional endpoints and IDs	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/regions
Configure Azure Speech containers runtime settings	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-configuration
Configure and run Azure Speech language ID containers	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-lid
Configure Redis cache for speech diarization containers	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-speech-to-text-diarization-cache
Control speech output using SSML configuration	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-synthesis-markup
Configure pronunciation with SSML phonemes and lexicons	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-synthesis-markup-pronunciation
Structure SSML documents and events for Speech	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-synthesis-markup-structure
Configure Speech CLI datastore search order and files	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/spx-data-store-configuration
Configure output destinations for Speech CLI results	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/spx-output-options
Configure batch synthesis properties for TTS avatars	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/text-to-speech-avatar/batch-synthesis-avatar-properties
Configure languages and locales for Voice Live API	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-language-support

Integrations & Coding Patterns

Topic	URL
Integrate Speech service with call center telephony	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/call-center-telephony-integration
Use Speech SDK APIs to handle recognition results	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/get-speech-recognition-results
Implement text-to-speech synthesis with Speech SDK	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-speech-synthesis
Translate speech using Azure Speech APIs	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-translate-speech
Integrate Voice Live with Foundry text agents	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-agent-integration
Implement function calling in Voice Live sessions	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-function-calling
Integrate Voice Live with Foundry hosted agents	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-hosted-agent-integration
Connect MCP servers to Voice Live sessions	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-mcp-server
Add proactive greeting messages to Voice Live agents	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-voice-live-proactive-messages
Integrate MAI-Transcribe-2-Streaming via Realtime API	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/mai-transcribe-2-streaming-realtime
Integrate MAI-Transcribe-2-Streaming with Speech SDK	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/mai-transcribe-2-streaming-speech-sdk
Integrate Azure Speech with Azure OpenAI chat	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/openai-speech
Integrate personal voice speaker profiles in apps	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/personal-voice-how-to-use
Use Power Automate connector for Speech batch transcription	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/power-automate-batch-transcription
Call Azure Speech-to-Text via REST API	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/rest-speech-to-text
Call Azure Speech-to-text short audio REST API	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/rest-speech-to-text-short
Call Speech text to speech REST API endpoints	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/rest-text-to-speech
Use SSML phonetic alphabets with Azure Speech	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-ssml-phonetic-sets
Use SSML to customize Azure Speech voices	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-synthesis-markup-voice
Generate Speech service REST clients from Swagger	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/swagger-documentation
Control text to speech avatar gestures with SSML	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/text-to-speech-avatar/avatar-gestures-with-ssml
Implement real-time text-to-speech avatar streaming	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/text-to-speech-avatar/real-time-synthesis-avatar
Connect Voice Live to Foundry Agent Service	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-agents-quickstart
Integrate advanced Voice Live API 2025-10-01	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-api-reference-2025-10-01
Use preview Voice Live API 2026-01-01	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-api-reference-2026-01-01-preview
Use Voice Live API 2026-04-10 for streaming	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-api-reference-2026-04-10
Adopt preview Voice Live API 2026-06-01	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-api-reference-2026-06-01-preview
Implement real-time Voice Live WebSocket events	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-api-reference-2026-07-15
Implement real-time agents with Voice Live API	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-how-to
Use Voice Live WebRTC API for real-time audio	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/voice-live-webrtc

Deployment

Topic	URL
Use Batch synthesis API for long-form text-to-speech	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/batch-synthesis
Deploy custom speech models and endpoints	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/how-to-custom-speech-deploy-model
Run custom speech to text containers with Docker	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-cstt
Deploy fast transcription speech containers on-premises	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-ft
Deploy and run Speech containers with Docker	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-howto
Run Speech containers on Kubernetes with Helm	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-howto-on-premises
Deploy neural text to speech containers with Docker	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-ntts
Deploy speech-to-text containers with Docker	https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-container-stt

Comments

Markdown supported

Details

Author: microsoftdocs
Repository: microsoftdocs/agent-skills
Category: Development
Installs: 241
GitHub stars: 796

Report

More skills

All skills

remotion-render

github.com/inference-sh

1.6M

Render videos from React/Remotion component code via inference.sh. Pass TSX code, get MP4. Supports all Remotion APIs: useCurrentFrame, useVideoConfig, spring, interpolate, AbsoluteFill, Sequence. Configurable resolution, FPS, duration, codec. Use for: programmatic video generation, animated graphics, motion design, data-driven videos, React animations to video. Triggers: remotion, render video from code, tsx to video, react video, programmatic video, remotion render, code to video, animated video, motion graphics code, react animation video

improve-codebase-architecture

github.com/mattpocock

1.2M

Scan a codebase for architecture improvement opportunities, present them as a visual HTML report, then dive deep into whichever one you pick.

design-mobile-apps

github.com/designed-by-ai

1.1M

Design mobile app screens with Sleek, edit Sleek projects, and implement their designs in React Native or HTML

vercel-react-best-practices

github.com/vercel-labs

848.6k

React and Next.js performance optimization guidelines from Vercel Engineering. This skill should be used when writing, reviewing, or refactoring React/Next.js code to ensure optimal performance patterns. Triggers on tasks involving React components, Next.js pages, data fetching, bundle optimization, or performance improvements.