Omer van Kloeten
Omer van Kloeten
Predicates are currently created as ASTs, but are not compiled or optimized. Instead, evaluating them means traversing the tree in its entirety, something that, in a tight loop (like going...
`Literal`s are currently only used for two purposes: 1. Type-safe casts 2. Type-safe comparators They are not usually needed together and whenever one is needed, a new `Literal` is instantiated....
Currently, implementing idempotent jobs over Iceberg is done via data-based predicates. For instance, if a job run is presumed to have written the data for `2018-08-05`, you will write something...
(this is very similar in philosophy to #47 and it would be good to read that before this, same caveats applying) A job that wants to read only new data...
A very long classpath including user jars is loaded when a Spark node starts. Instead of users having to figure out which jars are in memory whenever they change a...