feathub icon indicating copy to clipboard operation
feathub copied to clipboard

Apply filter before implementation

Open yunfengzhou-hub opened this issue 11 months ago • 0 comments

In flink_table_builder.py, the method _apply_filter_if_any is applied after transformations. This filtering should be applied before transformations and other logics if possible to reduce computations.

Same for spark_dataframe_builder.py.

yunfengzhou-hub avatar Sep 18 '23 00:09 yunfengzhou-hub