CloudFormation stack for deploying ChatQnA using Amazon Bedrock with pluggable LLM

[arun-gupta]

ChatQnA is one of the GenAI examples. It is a chatbot for question and answer through retrieval augmented generation (RAG). All details about the sample are available at https://github.com/opea-project/GenAIExamples/tree/main/ChatQnA.

This example uses Llama2 as the bundled LLM. There is a need to show how Amazon Bedrock can be used with this example and choose a range of LLMs. The underlying LLM could be a parameter. Any of the deployment mechanisms (Docker Compose, Amazon EKS, or AWS Fargate) can be used.