Alex Bush

Track lineage in Waimak

1

It might be nice to track label lineage in Waimak and attach it to some kind of label metadata structure. It would contain the input labels and dependencies that were...

Worth thinking about since S3 is eventually consistent in some cases

Allow the fail behaviour of the Parallel Scheduler to be configurable

1

## Expected Behaviour Parallel scheduler would be configured to behave in the case of failures to: - Fail all actions currently in progress (actions are terminated mid-execution) - Allow currently...

Auto-detect schema change a recreate tables for HadoopConnectors

1

## Expected Behavior Auto-detect if a schema has changed for a table and recreate table accordingly, rather than requiring `forceRecreateTables` flag. ## Actual Behavior The `forceRecreateTables` must be set to...

It is currently hard to track when configuration for the clean-up strategy function is incorrect resulting in untracked data growth. ## Expected Behavior Exception should be thrown if configuration for...

Implement a filter flow action that would take a list of labels to filter with. All actions related to these labels would be executed, and unrelated actions would be filter...

## Expected Behavior Consistent use of logging levels in Waimak. Minimal use of INFO level. ## Actual Behavior Many messages (especially in storage) and logged at INFO when DEBUG should...