cascalog-graph

cascalog-graph copied to clipboard

Seems to work, but not extensively tested

jeroenvandijk

The tap argument below will result in a very unreadable error ``` ... --my-tap my-tap.hfs-textline?sinkmode-replace ``` This should be fixed

jeroenvandijk

Add better failure information

4

Currently Cascalog Checkpoint reports errors as "ERROR checkpointed-workflow (Thread-23): Component failed" and you get the stacktrace. Many times this stacktrace is enough, but sometimes it is hard to see which...

jeroenvandijk

One of the main things that is missing in complex flows is the timing of steps. It would help for debugging purposes if we could add meta functions around steps....

jeroenvandijk

Currently there can be unnecessary steps to fulfil a graph. In order to fix this the graph "compiler" should minimize the number of local steps and combine steps when possible.

jeroenvandijk