Support for OpenAI Realtime API (AEGHB-852)

[nischalj10]

Answers checklist.

• [X] I have read the documentation ESP-IDF Programming Guide and the issue is not addressed there.
• [X] I have updated my IDF branch (master or release) to the latest version and checked that the issue is present there.
• [X] I have searched the issue tracker for a similar issue and not found a similar issue.

General issue report

Voice powered edge devices are becoming more and more prevalant. Voice-to-Voice is a very powerful modality to interact with AI for masses.

I would love if the support for OpenAI's Realtime Voice API can be added in esp-iot-solution

[duketxl]

I'm adding realtime support based on esp-adf

[nischalj10]

That'd be awesome. Thanks!

[nischalj10]

hey @duketxl! just curious if you were able to work on the direction. would love to see a reference implementation as I dive in to it as well!

[baapar1101]

when done it ?

[duketxl]

It is now possible to directly use OpenAI's demo.

Albert Heidarian @.***> 于2024年12月29日周日 09:21写道：

when done it ?

— Reply to this email directly, view it on GitHub https://github.com/espressif/esp-iot-solution/issues/416#issuecomment-2564576651, or unsubscribe https://github.com/notifications/unsubscribe-auth/AABQ27TXMSBYELAM4TUQL2T2H5FBRAVCNFSM6AAAAABQOQZKJCVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNRUGU3TMNRVGE . You are receiving this because you were mentioned.Message ID: @.***>

[duketxl]

https://github.com/openai/openai-realtime-embedded-sdk

[duketxl]

We finished this audio board a year ago and are waiting for OpenAI to open the interface.