aws-genai-llm-chatbot
aws-genai-llm-chatbot copied to clipboard
Feature request: Option to disable cross encoder models
Currently cross encoder models are used to rank the search results but the models available need to be hosted on Sagemaker which increases cost significantly. Having an option to disable cross encoder models would be helpful while exploring the chatbot so that Sagemaker costs can be avoided. With a toggle on UI or an option during deployment would be helpful.
This issue is stale because it has been open for 60 days with no activity.
Work is in progress as part of https://github.com/aws-samples/aws-genai-llm-chatbot/pull/286