gpt-researcher
gpt-researcher copied to clipboard
[Feature request] Add API tool to agents and use vector store for tools retrieval
Currently retrieval of data is done either by search, webscraping, or vector stores. The ability to use API by describing their specification in a tool description would be a great addition to extend the search capabilities of GPT Researcher.
One challenge with such approach though is that some APIs can have many endpoints, making it challenging by having to declare many tools for the agent. One way to overcome this is to provide API endpoint description, path and specification for each endpoint, and index these in a vector database with the description as a embedding, and the path and specification as metadata. In that case, the agent would first make a similarity search for its current task over the tools vector db, retrieve the tool to use, and generate the payload to make the api call based on the specification retrieved. We could either index other methods (websearch), or having a first step as a router that would determine if this is within the scope of a web search or attempt to find a tool to accomplish the task.
In any case, as a first step, getting an API tool would be amazing