Migrate to a proper logging system
Currently, we don't store logs. Where we do use logs, these are 'captured' by the agent context running them (STDERR/OUT). This is imperfect, because they are not persisted anywhere.
We should add logging to all the tools, and eval trajectory runners to enhance useability.
Hi @JackHopkins ! maybe i can take up this task. There are a couple of options of logging tools and libraries for our usecase. I think using https://wandb.ai/site/weave/ could be a good option. Let me know your thoughts.
what i personally didnt like about wandb was self hosting , if local traces are not important i think it's quite fine .
for tracing , there's not really a lot of reasons to use any frameworks , but i liked langgraph from langchain because it's so easy to launch
My fault for not seeing this and making a duplicate issue, closing due to https://github.com/JackHopkins/factorio-learning-environment/issues/240