music-video-generation

音乐视频生成

使用 each::sense 生成精彩的音乐视频。这项技能可创作与音轨同步的可视化效果、歌词视频、动画片段和电影感音乐视频。

功能

• 音频可视化效果：随音频频率变化的动态视觉图案
• 歌词视频：配有歌曲歌词的动态排版
• 抽象视觉效果：艺术化、非具象的视频内容
• 艺人表演：模拟艺人或乐队的表演画面
• 动画音乐视频：卡通、动漫或风格化动画
• 演唱会视觉效果：LED 墙内容和舞台投影
• 专辑封面动画：让静态专辑封面焕发生机
• 节拍同步内容：随节奏和速度变化的视觉效果
• 特定曲风美学：嘻哈、EDM、摇滚、流行风格

快速入门

curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create an audio visualizer video with neon geometric shapes that pulse to the beat, dark background with vibrant colors"}],
    "model": "eachsense/beta",
    "stream": true,
    "mode": "max"
  }'

视频格式和宽高比

平台	宽高比	分辨率	用途
YouTube	16:9	1920x1080	标准音乐视频
YouTube Shorts	9:16	1080x1920	竖屏片段、预览
Instagram Reels	9:16	1080x1920	社交媒体推广
TikTok	9:16	1080x1920	爆款片段
方形	1:1	1080x1080	Instagram 信息流、Spotify Canvas
超宽屏	21:9	2560x1080	演唱会 LED 墙

使用场景示例

1. 根据音轨生成音频可视化效果

curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create a 16:9 audio visualizer video. Circular waveform in the center with particles emanating outward on each beat. Deep purple and electric blue color palette. Dark space background with subtle stars. 10 seconds loop."}],
    "model": "eachsense/beta",
    "stream": true,
    "mode": "max"
  }'

2. 生成歌词视频

curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create a lyric video for the lyrics: \"Running through the night, chasing starlight, we are infinite tonight\". Animated text appearing word by word with a dreamy night sky background. Stars twinkling, soft gradient from dark blue to purple. Modern sans-serif font with subtle glow effect. 16:9 aspect ratio."}],

    "model": "eachsense/beta",
    "stream": true,
    "mode": "max"
  }'

3. 抽象音乐视觉效果

curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Generate abstract music visuals for an ambient electronic track. Flowing liquid metal morphing shapes, iridescent surfaces reflecting rainbow colors, slow hypnotic movement. Think art installation meets music video. 16:9, 15 seconds."}],
    "model": "eachsense/beta",
    "stream": true,
    "mode": "max"
  }'

4. 艺人表演视频

curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create a music video showing a female singer performing on a dark stage. Dramatic spotlight lighting, smoke effects, cinematic camera movement circling the performer. She is wearing an elegant black dress, passionate emotional performance. 16:9 widescreen, film grain aesthetic."}],
    "model": "eachsense/beta",
    "stream": true,
    "mode": "max"
  }'

5. 动画音乐视频（动漫风格）

curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create an anime-style animated music video. A young character with colorful hair running through a neon-lit cyberpunk city at night. Dynamic action poses, speed lines, rain effects. Japanese anime aesthetic like Studio Trigger. High energy and dramatic. 16:9."}],
    "model": "eachsense/beta",
    "stream": true,
    "mode": "max"
  }'

6. 演唱会 LED 墙视觉效果

curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Generate concert visuals for LED wall projection. Abstract geometric patterns - triangles and hexagons morphing and pulsing. High contrast black and white with occasional bursts of red. Designed for live performance, loopable, high impact visuals that work on massive screens. 21:9 ultrawide aspect ratio."}],
    "model": "eachsense/beta",
    "stream": true,
    "mode": "max"
  }'

7. 专辑封面动画（Spotify Canvas）

curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create a Spotify Canvas style animation from album art concept. A surreal landscape with floating islands and waterfalls going upward. Soft pastel colors - pink clouds, turquoise water, golden sunset light. Subtle parallax motion, dreamy and ethereal mood. 9:16 vertical format, 8 second seamless loop."}],
    "model": "eachsense/beta",
    "stream": true,
    "mode": "max"
  }'

8. 节拍同步视觉效果

curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create beat-synced visuals for a 120 BPM track. Geometric shapes (cubes, spheres, pyramids) that flash and transform on each beat. Strobe-like intensity changes. Black background with neon pink, cyan, and yellow shapes. High energy, rave aesthetic. Design cuts to happen every 0.5 seconds to match tempo. 16:9."}],
    "model": "eachsense/beta",
    "stream": true,
    "mode": "max"
  }'

9. 特定曲风美学（嘻哈）

curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create a hip-hop music video aesthetic. Urban street scene at night, street lights with lens flares, graffiti walls, luxury cars in background. Slow motion rain falling. Moody cinematic color grading - teal shadows and orange highlights. Trap music vibe, high production value look. 16:9 widescreen."}],
    "model": "eachsense/beta",
    "stream": true,
    "mode": "max"
  }'

10. 叙事型音乐视频

# Part 1: Opening scene
curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create the opening scene of a narrative music video. A lonely figure standing at a train station at dawn. Empty platform, morning mist, warm golden light breaking through clouds. Melancholic mood, cinematic widescreen composition. The character is looking at a departing train. 16:9."}],
    "model": "eachsense/beta",
    "stream": true,
    "session_id": "music-video-story-001",
    "mode": "max"
  }'

# Part 2: Middle scene (same session for consistency)
curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create the next scene continuing our music video story. The same character is now walking through a sunlit field of wildflowers. Memories and flashbacks - double exposure effect showing happy moments. Bittersweet emotion, hope emerging. Maintain the same cinematic color grading and style."}],
    "model": "eachsense/beta",
    "stream": true,
    "session_id": "music-video-story-001",
    "mode": "max"
  }'

# Part 3: Final scene
curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create the final climactic scene of our music video. The character reunites with a loved one on a rooftop at sunset. City skyline in background, warm embrace, emotional payoff. Golden hour lighting, lens flares, cinematic slow motion. End on a hopeful note with them looking at the horizon together."}],
    "model": "eachsense/beta",
    "stream": true,
    "session_id": "music-video-story-001",
    "mode": "max"
  }'

最佳实践

视觉设计

• 色彩一致性：在整段视频中保持统一的配色方案
• 动态节奏：让视觉强度与音乐能量相匹配
• 安全区域：针对社交平台，将关键元素放在远离边缘的位置
• 循环衔接点：为可视化效果和短片段设计无缝循环
• 文字可读性：制作歌词视频时，确保文字与背景形成对比

技术注意事项

• 节拍时序：尽可能为节拍同步内容指定 BPM
• 时长：将片段控制在 5–30 秒，以获得最佳生成效果
• 循环播放：如需重复播放，请明确要求无缝循环
• 平台规格：务必指定目标平台的宽高比

曲风指南

曲风	视觉风格	配色方案	动态效果
EDM/电子	几何、霓虹、未来感	明亮霓虹、RGB	快速、充满活力
嘻哈/说唱	都市、奢华、电影感	深色搭配金色/青绿色	慢动作、戏剧化
摇滚/金属	粗粝、高对比度	深色、红色、单色	强烈、混乱
流行	多彩、精致、有趣	明亮、柔和	流畅、轻快
氛围/舒缓	抽象、流动	柔和渐变	缓慢、催眠
独立/另类	复古、艺术化	低饱和、胶片色调	自然、有机

音乐视频提示词技巧

创作音乐视频时，请包含以下细节：

1. 曲风/情绪：音乐类型和情感基调
2. 视觉风格：写实、动画、抽象等
3. 配色方案：指定颜色或整体氛围
4. 宽高比：16:9、9:16、1:1 或 21:9
5. 时长：片段应有多长
6. 动态风格：快速剪辑、慢动作、流畅等
7. 关键元素：视频中应出现的内容
8. 循环要求：是否需要无缝循环

提示词结构示例

"Create a [duration] [genre] music video in [aspect ratio].
Visual style: [style description].
Show [key visual elements].
Color palette: [colors].
Mood: [emotional tone].
[Additional requirements like looping, beat-sync, etc.]"

模式选择

“您想要快速且便宜，还是高质量？”

模式	最适合	速度	质量
max	正式发行、官方视频、高端内容	较慢	最高
eco	快速构思、社交媒体片段、迭代	较快	良好

多轮创意迭代

使用 session_id 迭代并完善音乐视频：

# Initial concept
curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create a visualizer with glowing orbs floating in space"}],
    "model": "eachsense/beta",
    "stream": true,
    "session_id": "visualizer-project-001"
  }'

# Refine based on result
curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Add more particle trails to the orbs and make the colors shift from blue to purple"}],
    "model": "eachsense/beta",
    "stream": true,
    "session_id": "visualizer-project-001"
  }'

# Create variation
curl -X POST https://eachsense-agent.core.eachlabs.run/v1/chat/completions \
  -H "Content-Type: application/json" \
  -H "X-API-Key: $EACHLABS_API_KEY" \
  -H "Accept: text/event-stream" \
  -d '{
    "messages": [{"role": "user", "content": "Create a more intense version of this for the chorus section with faster movement"}],
    "model": "eachsense/beta",
    "stream": true,
    "session_id": "visualizer-project-001"
  }'

错误处理

错误	原因	解决方案
Failed to create prediction: HTTP 422	余额不足	在 eachlabs.ai 充值
内容政策违规	内容不允许	调整提示词，使其符合内容政策
超时	生成过程复杂	将客户端超时设置为至少 10 分钟

相关技能

• each-sense - 核心 API 文档
• video-generation - 通用视频生成
• image-generation - 静态美术作品和静帧
• audio-generation - 音乐和声音创作