factorio-learning-environment icon indicating copy to clipboard operation
factorio-learning-environment copied to clipboard

Migrate to a proper logging system

Open JackHopkins opened this issue 7 months ago • 2 comments

Currently, we don't store logs. Where we do use logs, these are 'captured' by the agent context running them (STDERR/OUT). This is imperfect, because they are not persisted anywhere.

We should add logging to all the tools, and eval trajectory runners to enhance useability.

JackHopkins avatar May 12 '25 15:05 JackHopkins

Hi @JackHopkins ! maybe i can take up this task. There are a couple of options of logging tools and libraries for our usecase. I think using https://wandb.ai/site/weave/ could be a good option. Let me know your thoughts.

eshaanagarwal avatar May 13 '25 11:05 eshaanagarwal

what i personally didnt like about wandb was self hosting , if local traces are not important i think it's quite fine .

for tracing , there's not really a lot of reasons to use any frameworks , but i liked langgraph from langchain because it's so easy to launch

Josephrp avatar May 17 '25 10:05 Josephrp

My fault for not seeing this and making a duplicate issue, closing due to https://github.com/JackHopkins/factorio-learning-environment/issues/240

kiankyars avatar Jul 03 '25 12:07 kiankyars