fal-lip-sync

fal-lip-sync

Create talking head videos, sync lips to audio, and animate portraits using fal.ai models.

Scripts

Script	Purpose
talking-head.sh	Generate a talking head video from an image + audio/text
lip-sync.sh	Sync lips in an existing video to new audio

Usage

Talking Head (Image + Audio → Video)

./scripts/talking-head.sh --image-url "https://example.com/portrait.jpg" --audio-url "https://example.com/speech.mp3" --model veed/fabric-1.0

Talking Head (Image + Text → Video with auto TTS)

./scripts/talking-head.sh --image-url "https://example.com/portrait.jpg" --text "Hello, welcome to our presentation" --model fal-ai/creatify/aurora

Lip Sync (Video + Audio → Synced Video)

./scripts/lip-sync.sh --video-url "https://example.com/video.mp4" --audio-url "https://example.com/new-speech.mp3"

Arguments

talking-head.sh

Argument	Description	Required
--image-url	URL of portrait/face image	Yes
--audio-url	URL of audio to sync	Yes (or --text)
--text	Text to speak (auto TTS)	Yes (or --audio-url)
--model / -m	Model endpoint	No (default: veed/fabric-1.0)
--tts-model	TTS model for --text mode	No (default: fal-ai/minimax/speech-2.6-turbo)
--wait / -w	Wait for completion	No (default: true)
--async / -a	Return request ID immediately	No

lip-sync.sh

Argument	Description	Required
--video-url	URL of video to lip sync	Yes
--audio-url	URL of audio to sync to	Yes
--model / -m	Model endpoint	No (default: fal-ai/sync-lipsync/v2)

Finding Models

To discover the best and latest lip sync and talking head models, use the search API:

# Search for talking head models
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "talking head"

# Search for lip sync models
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "lip sync"

# Search for live portrait / expression transfer
bash /mnt/skills/user/fal-generate/scripts/search-models.sh --query "live portrait"

Or use the search_models MCP tool with relevant keywords like "lip sync", "talking head", "avatar".

Output Format

{
  "video": {
    "url": "https://fal.media/files/...",
    "content_type": "video/mp4"
  }
}

Present the video URL directly to the user.