issue: No docs on web loaders

[rragundez]

I am making tests using the web search functionality and I see quite different behaviour from the different loaders, unfortunately there is no documentation about what their difference in terms of accuracy and speed for example.

• SafeWebBaseLoader
• SafePlaywrightURLLoader
• SafeFireCrawlLoader

I do see they are based on some langchain loaders but they also contain significant custom logic in open webui.

In particular SafeWebBaseLoader sometimes kinda hangs, and I would suspect it is because one of the sites is giving it trouble and it keep retrying with backoff but the logs are not really telling anything about that and I do not know how to find it out or change the bahaviour.

Hope someone can help clarifying the differences, even if it is just some simple bullet points would help.

As a general comment, it appears that the documentation about features kinda stopped at some point and now new features are either not documented or poorly documented, like things as simple as available environment variables to control web search behaviour, I had to go into the source code to find that out. IMO as I have seen in other open source projects if this continues it limits the usability of the product for non-experts that are not contributors to the project.