Enhance knowledge gathering abilities

[Pwuts]

AutoGPT should be able to pull information/knowledge from the web, and for efficiency's sake, this shouldn't be handled in the main agent loop.

Proposal

Construct a fast and efficient knowledge gathering workflow that is capable of fulfilling the agent's knowledge needs.

Resources

• OpenSearch

[github-actions[bot]]

This issue has automatically been marked as stale because it has not had any activity in the last 50 days. You can unstale it by commenting or removing the label. Otherwise, this issue will be closed in 10 days.

[Pwuts]

We're working on this. TODO's so far:

• [ ] Improve web browsing capabilities
  • [x] feat(agent/web): Improve read_webpage information extraction abilities
  • [x] #6778
  • [ ] Explore whether #3200 would help
• [ ] Integrate OpenSearch/OSit
• [ ] Improve OpenSearch/OSit(?)