[Feature Request] Centralised internet search configuration

[mludvig]

Describe the solution you'd like

Centralised way to configure the internet search engine (DuckDuckGo or Firecrawl) and the credentials (Firecrawl API key) rather than having to configure it separately for each bot.

With this in place the Bot configuration can be simplified to Internet Search Yes / No and if yes how many documents to retrieve.

The search engine type and creds can be in Secrets Manager - we can create that with CDK and populate from cdk.json / parameters.ts defaults.

Why the solution needed

Users should be able to create their own bots but don't necessarily need to have access to the required API keys and know which search engine to use.

Implementation feasibility

Are you willing to collaborate with us to discuss the solution, decide on the approach, and assist with the implementation?

• [x] Yes, I am able to implement the feature and create a pull request.

Hope there's an appetite for this :)

[statefb]

Thank you for this thoughtful proposal! I agree with the goal of simplifying bot configuration for users.

However, I have some concerns about implementing this as a global configuration in cdk.json. Services like Firecrawl typically have throttling quotas and rate limits per API key, so with a centralized approach using shared credentials, multiple users creating bots simultaneously could quickly exhaust these limits. What are your thoughts on this potential issue?

[mludvig]

@statefb regarding the quotas concern - I believe that in a typical corporate scenario the credits will be provided by the company. In our case our end users won't even have perms to create new bots as that involves a lot of technical questions that they wouldn't know how to answer. So the company provides the Firecrawl credits and the users simply use it.

Another benefit is that adding a new engine (e.g. Serper or similar) will be a centralised change and all bots with Internet Search = True will immediately benefit from it without any reconfiguration.