rai icon indicating copy to clipboard operation
rai copied to clipboard

Refactor Human-Machine-Interface

Open maciejmajek opened this issue 6 months ago • 0 comments

Is your feature request related to a problem? Please describe. The current HMI implementation is unnecessarily complicated, with vastly different solutions for text and voice interfaces.

Describe the solution you'd like The HMI should implement a base class for any I/O modality. It's well known that different modalities vary in their ability to convey different aspects of a conversation. For example, a Streamlit/chat-like interface can easily display a thought process, including showing images, while voice communications cannot. The implementation should take these issues into account.

One possible solution would be to use a callback system that attaches to different parts of the HMI agent.

maciejmajek avatar Aug 16 '24 13:08 maciejmajek