mcpField
E
elevenlabs-dubbing

elevenlabs-dubbing

github.com/inference-shCreative & media789757 installsUpdated 2w ago
Repository

About elevenlabs-dubbing

A skill for dubbing audio and video into 29 languages through ElevenLabs and the inference.sh CLI. It describes speaker detection, voice preservation, and timing alignment for creators and teams localizing content.

Key features

  1. 01Dubbing into 29 languages
  2. 02Automatic speaker detection
  3. 03Preservation of speaker voice traits
  4. 04Speech timing and pacing alignment
  5. 05MP3, MP4, WAV, and MOV inputs

Use cases

  1. 01Localizing video for international audiences
  2. 02Adapting online courses for other languages
  3. 03Distributing podcasts in multiple languages
  4. 04Preparing multilingual training materials

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/inference-sh/skills --skill elevenlabs-dubbing

After installing, type/elevenlabs-dubbingin Claude Code to confirm it loaded.

Details

From the project README

Install the belt CLI skill: npx skills add belt-sh/cli

ElevenLabs Dubbing

Automatically dub audio and video into 29 languages via inference.sh CLI.

Dubbing

Quick Start

Requires inference.sh CLI (belt). Install instructions

belt login

# Dub English video to Spanish
belt app run elevenlabs/dubbing --input '{
  "audio": "https://video.mp4",
  "target_lang": "es"
}'

Supported Languages

CodeLanguageCodeLanguage
enEnglishkoKorean
esSpanishruRussian
frFrenchtrTurkish
deGermannlDutch
itItaliansvSwedish
ptPortuguesedaDanish
plPolishfiFinnish
hiHindinoNorwegian
arArabiccsCzech
zhChineseelGreek
jaJapaneseheHebrew
huHungarianidIndonesian
msMalayroRomanian
thThaiukUkrainian
viVietnamese

Supported Input Formats

  • MP3, MP4, WAV, MOV

Examples

Dub Video to Spanish
belt app run elevenlabs/dubbing --input '{
  "audio": "https://english-video.mp4",
  "target_lang": "es"
}'
Dub Audio to French
belt app run elevenlabs/dubbing --input '{
  "audio": "https://podcast-episode.mp3",
  "target_lang": "fr"
}'
Specify Source Language
# Skip auto-detection, specify source
belt app run elevenlabs/dubbing --input '{
  "audio": "https://german-video.mp4",
  "source_lang": "de",
  "target_lang": "en"
}'
Multi-Language Distribution
# Dub to multiple languages
for lang in es fr de ja ko; do
  belt app run elevenlabs/dubbing --input "{
    \"audio\": \"https://video.mp4\",
    \"target_lang\": \"$lang\"
  }" > "dubbed_${lang}.json"
  echo "Dubbed to $lang"
done

Features

  • Auto Speaker Detection: Identifies multiple speakers automatically
  • Voice Preservation: Maintains original speaker voice characteristics
  • Timing: Matches original speech timing and pacing
  • Multi-Speaker: Handles videos with multiple speakers

Workflow: Localize Content Pipeline

# 1. Start with original video
# 2. Dub to target language
belt app run elevenlabs/dubbing --input '{
  "audio": "https://original-video.mp4",
  "target_lang": "es"
}' > dubbed.json

# 3. Add subtitles in target language
belt app run elevenlabs/stt --input '{
  "audio": "<dubbed-audio-url>",
  "language_code": "spa"
}' > transcript.json

# 4. Caption the dubbed video
belt app run infsh/caption-videos --input '{
  "video_file": "<dubbed-video-url>",
  "segments": [{"start": 0.0, "end": 2.5, "text": "<text-from-transcript>"}]
}'

Use Cases

  • Content Creators: Reach international audiences
  • E-learning: Localize courses for global students
  • Marketing: Adapt campaigns for different markets
  • Podcasts: Distribute in multiple languages
  • Corporate: Multilingual training and communications
  • Film/TV: Quick dubbing for distribution

Related Skills

# ElevenLabs TTS (generate speech in any language)
npx skills add inference-sh/skills@elevenlabs-tts

# ElevenLabs STT (transcribe dubbed content)
npx skills add inference-sh/skills@elevenlabs-stt

# ElevenLabs voice changer (transform voices)
npx skills add inference-sh/skills@elevenlabs-voice-changer

# Full platform skill (all apps)
npx skills add inference-sh/skills@infsh-cli

Browse all audio apps: belt app list --category audio

Comments

Markdown supported