aws-genai-llm-chatbot icon indicating copy to clipboard operation
aws-genai-llm-chatbot copied to clipboard

Feature request: Expose consumable APIs

Open azaylamba opened this issue 1 year ago • 3 comments

Consumable APIs would ensure that the chatbot functionality can be accessed by other products via APIs. It would make the integration with other products easy.

azaylamba avatar Feb 21 '24 17:02 azaylamba

@massi-ang @bigadsoleiman are there any plans for such feature in the future?

azaylamba avatar Apr 13 '24 06:04 azaylamba

Could you please share:

  • Required functions to expose initially (e.g., just query and response)?
  • Primary use case (e.g., integrating the chatbot into your own UI) -- anything specific you could share?
  • Performance or scalability requirements?

ystoneman avatar Apr 14 '24 22:04 ystoneman

@ystoneman The initial requirement is to ask questions and get responses. And maybe authentication as well so that only authenticated users can call the APIs. Primary use case is the ability to integrate the chatbot into multiple products (e.g. web app having own UI, mobile, desktop app etc). The APIs should be able to handle moderate load (e.g. 100 users calling the APIs simultaneously). And the response time of the APIs should be similar to what it is today in the web app.

Also the streaming response is desirable.

azaylamba avatar Apr 16 '24 12:04 azaylamba

This issue is stale because it has been open for 60 days with no activity.

github-actions[bot] avatar Jun 16 '24 01:06 github-actions[bot]

This issue was closed because it has been inactive for 30 days since being marked as stale.

github-actions[bot] avatar Jul 17 '24 01:07 github-actions[bot]