Home›Launches›Recall.ai
12

Recall.ai: Output Media API - AI agents that talk in meetings 🤖

Use our Output Media API to build AI agents that join video conferences on Zoom, Meet, Teams, and Webex.

David Gu
Recall.ai
 
https://www.recall.ai
#api#artificial_intelligence

TLDR - Recall.ai’s Output Media API lets you build AI agents that join video conferences on Zoom, Meet, Teams, and Webex. These agents can output audio and video, listen, and respond like real participants.

https://youtu.be/YzzzqPpL47o

Today, we're excited to introduce the Output Media API. With this API, you can easily build live, interactive AI agents that can listen and react to meetings in real time.

📈 The Problem and Solution

For developers, building AI agents have become much easier with APIs like the OpenAI realtime API. The difficult part is actually getting your AI agent into a video conference. This is because there are no APIs to send and receive low-latency video streams from Zoom, MS Teams, Google Meet etc.

The solution is to use a service like Recall.ai which provides an API to create virtual participants that can join video conferences, receive the real-time data from the conference, and display the agent as a participant in the meeting.

🤖 AI Agents as a Web App

The Output Media API works by rendering any web app into ultra-low-latency audio and video, and streaming that into your video conference through a bot.

This functionality makes it possible to develop AI agents that listen to the meeting audio and react in real-time, in just a few steps:

  1. Develop a webpage that listens to and reacts to audio coming from the microphone (e.g. via getUserMedia)
    • Recall.ai sends the mixed audio of the meeting to the webpage microphone so your agent can listen to what’s being said
  2. Send a Recall.ai bot to a meeting and configure it to show the webpage you developed
// POST /api/v1/bot/
{
  "meeting_url": "https://us02web.zoom.us/j/1234567890",
  "bot_name": "Recall.ai Notetaker",
  "output_media": {
    "camera": {
      "kind": "webpage",
      "config": {
        "url": "https://{YOUR_WEBPAGE_URL}"
      }
    }
  }
}

🚀 Getting Started:

  • Check out our Output Media Guide.
  • We’ve built 2 sample apps using Output Media, with walkthroughs of how they’re built.

See All Launches ›