mcpField
T
tavus-overview

tavus-overview

github.com/tavus-engineeringOther958 installsUpdated 39w ago
Repository

About tavus-overview

tavus-overview describes Tavus, an AI research lab, and its products for real-time conversational video and video generation. It outlines CVI components, proprietary models, APIs, and application areas for developers and organizations.

Key features

  1. 01Real-time conversational video platform
  2. 02Replica, Persona, and Conversation components
  3. 03Phoenix-4, Raven-1, and Sparrow-1 models
  4. 04Video generation and Replica APIs
  5. 05PALs with persistent memory

Use cases

  1. 01Embedding video conversations in applications
  2. 02Creating personalized videos from scripts or audio
  3. 03Building digital twins from training video
  4. 04Providing tutoring or customer support

Install

Copy the command and run it in a terminal.

$npx skills add https://github.com/tavus-engineering/tavus-skills --skill tavus-overview

After installing, type/tavus-overviewin Claude Code to confirm it loaded.

Details

From the project README

Tavus Overview

Tavus is a San Francisco-based AI research lab pioneering Human Computing — teaching machines the art of being human.

Mission

"Automation has scaled efficiency but stripped away empathy, nuance, and presence from digital interactions."

Tavus exists to close the gap between humans and machines by creating AI that can see, hear, understand, and respond with emotional intelligence in real time. Not chatbots with faces — authentic, face-to-face digital presence.

What is Human Computing?

Human Computing is a paradigm shift: computing that adapts to humans, not the other way around.

Core principles:

  • Human UI: Interact with AI as naturally as talking to another person — no commands, no learning curve
  • Presence over automation: AI that feels like someone, not something
  • Emotional intelligence: Reading tone, expressions, context — not just words

The Conversational Video Interface (CVI)

CVI is Tavus's flagship product — an API-first platform for real-time, face-to-face AI conversations.

What makes CVI different from chatbots/avatars:

  • Real-time interactive conversation (not pre-rendered video)
  • ~600ms latency utterance-to-utterance
  • Reads facial expressions, interprets tone, adapts in real-time
  • Full orchestration: function calling, RAG, memories
  • White-labeled, embeddable, enterprise-ready

CVI Components:

ComponentWhat it does
ReplicaThe visual avatar — your AI's face and appearance
PersonaBehavior, personality, LLM config, system prompt
ConversationA live WebRTC session connecting replica + persona

The Model Stack

Tavus builds proprietary models that work together to create human presence:

Phoenix-4 (Rendering)

Gaussian-diffusion model for photorealistic face rendering. Synthesizes high-fidelity facial behavior with:

  • Micro-expressions and subtle movements
  • Full-face animation (not just lips)
  • Real-time emotional response
  • Identity preservation
Raven-1 (Perception)

Multimodal perception model that lets AI "see":

  • Reads facial expressions and body language
  • Detects emotions and intent
  • Analyzes environment and screen content
  • Contextual awareness
Sparrow-1 (Turn-Taking)

Transformer-based dialogue model for natural conversation flow:

  • Knows when to listen, pause, or speak
  • ~600ms response latency
  • Handles interruptions naturally
  • Multilingual support

Products

Conversational Video Interface (CVI)

API-first platform for developers to embed real-time AI video conversations.

  • Full pipeline: perception → STT → LLM → TTS → rendering
  • Customizable layers (bring your own LLM/TTS)
  • Knowledge base (RAG) and memories
  • Function calling for external integrations
Video Generation API

Async video generation from scripts or audio.

  • Personalized videos at scale
  • Custom backgrounds and watermarks
  • Transparent background support
Replica API

Create digital twins from 2 minutes of training video.

  • Studio-grade fidelity
  • Stock replicas available
  • Identity preservation
PALs (Personal AI Lifeforms)

Consumer-facing AI companions that remember, evolve, and connect.

  • Text, call, or video chat
  • Persistent memory
  • Proactive check-ins

Use Cases

  • Sales & Recruiting: AI SDRs, interviewers, qualification flows
  • Education: Tutors, trainers, onboarding
  • Healthcare: Patient companions, training simulations
  • Customer Support: 24/7 face-to-face assistance
  • Personal: Companions, coaches, productivity assistants

Key Stats

  • 2B+ interactions powered
  • ~600ms utterance-to-utterance latency
  • 30+ languages supported
  • SOC 2, GDPR, HIPAA compliant (enterprise)

Links

Platform & Docs
Resources
Community
Getting Started

Company

  • Founded: 2021 by Hassaan Raza & Quinn Favret
  • HQ: San Francisco
  • Backed by: Sequoia, Scale Venture Partners, Y Combinator, HubSpot
  • Category: Human Computing / AI Research Lab

Pricing Tiers

TierMinutesReplicasConcurrency
Free25Stock only1
Starter ($59/mo)1001 custom3
Growth ($397/mo)1,2503 custom15
EnterpriseCustomCustomCustom + SLAs

Ethics & Trust

Tavus is built on:

  • Informed consent: Every likeness used with permission
  • Transparent systems: No hidden levers
  • Full disclosure: You know how the magic works
  • Bias reviews: Active monitoring and advisory oversight

Comments

Markdown supported