cascalog-graph icon indicating copy to clipboard operation
cascalog-graph copied to clipboard

Add meta functions around steps for the use of extra logging and profiling

Open jeroenvandijk opened this issue 11 years ago • 0 comments

One of the main things that is missing in complex flows is the timing of steps. It would help for debugging purposes if we could add meta functions around steps. We could for example add extra logging around each step. Or log timing information; how long did it take to complete a certain step or a group of steps.

This idea is similar (but different implementation) to Prismatic's profiling function: https://github.com/Prismatic/plumbing/blob/master/src/plumbing/graph.clj#L280

jeroenvandijk avatar May 02 '13 09:05 jeroenvandijk