🗣 ᴾᴸᵁᴳᴵᴺ ᵁᴾᴰᴬᵀᴱ OpenAI GPT - Realtime Conversation now with Camera & Screen Sharing Capabilities

Hey Bubblers!

We’re excited to share a major update to our OpenAI GPT – Realtime Conversation Plugin.

The plugin now unlocks multimodal AI experiences by integrating on top of voice:

  • Camera :video_camera:
  • Screensharing :television:
  • Screenshot of an Element ID :camera_flash:
  • App Data Agent :page_facing_up:

This means you can build apps that feel more natural, interactive, and truly conversational, leveraging your app data.

What’s new:

  • Multimodal Support: Push the boundaries of AI by combining text, voice, video, and screen interactions in real time.
  • App Data Agent: Let AI fetch intelligently data from your app based on user query.
  • Reusable Prompts Integration (details here):
    • Keep your “secret sauce” (prompts, custom tools, etc.) completely hidden
    • Manage prompts directly from your OpenAI dashboard
    • Test and compare multiple prompt versions effortlessly

Try it out now with our live demo.

Simpler. Smarter. More secure.

gemini-live-video-demo

Enjoy!
Made with :black_heart: by wise:able
Discover more of our AI-powered Plugins.

2 Likes