spark-netflow icon indicating copy to clipboard operation
spark-netflow copied to clipboard

Published 20 hours ago • verified publisher icon sadikovi

Introduce more rules on predicate resolution

Open sadikovi opened this issue 8 years ago • 1 comments

Currently we support predicate resolution based on statistics and if one of the filters is trivial. We should also support situation when filter is And(GreaterThan(port, 10), GreaterThan(port, 12)), which should result in simple GreaterThan(port, 12).

sadikovi avatar Nov 30 '16 08:11 sadikovi

Currently it is assumed that Spark will handle this case and will never give us predicate like this, but when using just library it becomes quite handy to have this functionality.

sadikovi avatar Nov 30 '16 08:11 sadikovi