aws-genai-llm-chatbot icon indicating copy to clipboard operation
aws-genai-llm-chatbot copied to clipboard

Feature request: Option to disable cross encoder models

Open ajaylamba-provar opened this issue 2 years ago • 2 comments

Currently cross encoder models are used to rank the search results but the models available need to be hosted on Sagemaker which increases cost significantly. Having an option to disable cross encoder models would be helpful while exploring the chatbot so that Sagemaker costs can be avoided. With a toggle on UI or an option during deployment would be helpful.

ajaylamba-provar avatar Nov 17 '23 06:11 ajaylamba-provar

This issue is stale because it has been open for 60 days with no activity.

github-actions[bot] avatar Jan 26 '24 01:01 github-actions[bot]

Work is in progress as part of https://github.com/aws-samples/aws-genai-llm-chatbot/pull/286

azaylamba avatar Jan 29 '24 04:01 azaylamba