OpenAI DevDay Brings Real-Time API and More — Jason Michael Perry

This week was OpenAI’s annual DevDay, and it arrives amid significant changes—most notably, the resignation of CTO Mira Murati and ongoing organizational shifts as OpenAI potentially transitions from a non-profit to a for-profit company.

While I’ll dive deeper into the conference in next week’s newsletter, one standout announcement is the introduction of a Realtime API that supports speech-to-speech agent implementations for developers, complete with six customizable voices. This is a massive leap toward enabling developers to create truly agentic AI experiences, integrating Retrieval-Augmented Generation (RAG) for personalized data access.

The new API also allows speech as direct input for chat completions and more. There’s still plenty to unpack, but I’m excited to dive into the keynote highlights.

Uncategorized