Lots of "tool already loaded" warnings in evals

[ErikBjare]

Getting output like this when running a suite of 4 evals:

2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'append' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'browser' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'chats' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'patch' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'read' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'save' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'screenshot' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'shell' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'tmux' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'vision' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'ipython' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'append' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'browser' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'chats' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'patch' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'read' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'save' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'screenshot' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'shell' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'tmux' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'vision' already loaded
2025-01-14 13:34:18,583 - WARNING - gptme.tools - Tool 'ipython' already loaded
2025-01-14 13:34:18,584 - WARNING - gptme.tools - Tool 'append' already loaded
2025-01-14 13:34:18,584 - WARNING - gptme.tools - Tool 'browser' already loaded
2025-01-14 13:34:18,584 - WARNING - gptme.tools - Tool 'chats' already loaded
2025-01-14 13:34:18,584 - WARNING - gptme.tools - Tool 'patch' already loaded
2025-01-14 13:34:18,584 - WARNING - gptme.tools - Tool 'read' already loaded
2025-01-14 13:34:18,584 - WARNING - gptme.tools - Tool 'save' already loaded
2025-01-14 13:34:18,584 - WARNING - gptme.tools - Tool 'screenshot' already loaded
2025-01-14 13:34:18,584 - WARNING - gptme.tools - Tool 'shell' already loaded
2025-01-14 13:34:18,584 - WARNING - gptme.tools - Tool 'tmux' already loaded
2025-01-14 13:34:18,584 - WARNING - gptme.tools - Tool 'vision' already loaded
2025-01-14 13:34:18,584 - WARNING - gptme.tools - Tool 'ipython' already loaded
2025-01-14 13:34:18,585 - WARNING - gptme.tools - Tool 'append' already loaded
2025-01-14 13:34:18,585 - WARNING - gptme.tools - Tool 'browser' already loaded
2025-01-14 13:34:18,586 - WARNING - gptme.tools - Tool 'chats' already loaded
2025-01-14 13:34:18,586 - WARNING - gptme.tools - Tool 'patch' already loaded
2025-01-14 13:34:18,586 - WARNING - gptme.tools - Tool 'read' already loaded
2025-01-14 13:34:18,586 - WARNING - gptme.tools - Tool 'save' already loaded
2025-01-14 13:34:18,586 - WARNING - gptme.tools - Tool 'screenshot' already loaded
2025-01-14 13:34:18,586 - WARNING - gptme.tools - Tool 'shell' already loaded
2025-01-14 13:34:18,586 - WARNING - gptme.tools - Tool 'tmux' already loaded
2025-01-14 13:34:18,586 - WARNING - gptme.tools - Tool 'vision' already loaded
2025-01-14 13:34:18,586 - WARNING - gptme.tools - Tool 'ipython' already loaded

Could be a nasty source of issues. We should do something about it.

I've thought about passing around a toolchain with the loaded tools for a particular session instead of relying on globals, but not sure how much of a mess it would create.