Show results of hamilton DAG actions in Burr UI
Is your feature request related to a problem? Please describe. Burr has a tracer used to create spans for each step within a child hamilton DAG or any 3rd party package that supports burr tracers. However, there's no way to add the state transitions data.
Describe the solution you'd like Ideally, the DAG can add results to the span of each step.
Describe alternatives you've considered The alternative is to add
Additional context In the screenshot below, a DAG is being executed which leads to an error hence colored red. However, there is no way to see the individual results of each action within the DAG. Their ordering are also not in chronological order with the parent burr execution.
Update - https://github.com/DAGWorks-Inc/burr/pull/301 was merged with some features to help here. We should be able to get you to try something this week.
@osiloke I assume you're using the SimpleTracer, right?
Do you want to try installing the latest burr (0.26.0) and trying the following:
Replace the following function body:
context_manager = self.active_spans.pop(node_name)
attributes = {}
if not success:
attributes["error"] = "\n".join(traceback.format_exception(type(error), error, error.__traceback__))
else:
attributes["result"] = result
context_manager.log_attributes(**attributes)
context_manager.__exit__(None, None, None)
That will then log things at the end of each Hamilton function (you can obviously just log errors for example). If you then go to the Burr UI you should be able to see it. Would love feedback - I have a few ideas on how to make it better and would love more opinions.
I get something like this: