[Feature Request] Connect `EmbodiedAgent` in `RolePlaying`

[lightaime]

Required prerequisites

• [X] I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
• [X] Consider asking first in a Discussion.

Motivation

The current EmbodiedAgent is not yet integrated into RolePlaying with other agents yets.

Solution

No response

Alternatives

No response

Additional context

No response

[dandansamax]

Hi, @lightaime! This is a fascinating feature. Are you currently working on this issue? I would love to hear your thoughts on how we could implement it.

I'm particularly interested in this feature because I want to automate exception handling in our embodied agent by incorporating error messages into the role-playing conversation. It seems like this functionality might be related to the present issue. If you're occupied with other features, I'd be more than happy to assist with this. Let me know!

[lightaime]

Hi @dandansamax, I am not working on this one. It would be great if you could help! This one can be done by several ways.

1. Active way 1: Embodied agent as a function to call for the ChatAgent. Please checkout openai function call feature.
2. Active way 2: Let the ChatAgent know it has access to Embodied Agent by adding this to the system prompt.
3. Passive way: Just always send the output of the ChatAgent to the Embodied agent.

Please feel free to let me know if you have any questions!