optd
optd copied to clipboard
CMU-DB's Cascades optimizer framework
Somewhere between a proof of concept and a draft—work still heavily in progress. Will already successfully parse and fully unnest a subset of correlated and uncorrelated subqueries (although I am...
- [x] basic framework - [x] default physical properties builder (without any constraints) - [x] test default builder - [ ] ordering physical properties builder (Sort -> order) - [...
DO NOT MERGE. This PR implements the remainder of the projection transpose series of rules. ### List of Necessary Fixes Prior to Merge - [ ] Projection Push Down Join...
**Summary**: Automatically converting CSV to Parquet before generating stats on the Parquet files. **Demo**:  **Details**: * For robustness, we don't use schema inference. We...
### Notes * Sometimes Postgres does really bad (even worse than our magic numbers!). However, the goal right now is simply to match Postgres, not to match the truecard. When...
- [x] Q1 #78 - 🚧 Not working in perftest: `Error: ArrowError(NotYetImplemented("Unsupported Interval Expression with value \"115 day (3) seconds\""))` - [x] Q2 #80 - [x] Q3 #86 - [...
This would be a far-in-the-future thing, but just as a note, for filter pushdown, we would have to take it into account when pushing past project
# Why we have MergeGroup in the first place? For both testing the optd cascades core and shrinking the search space, we were trying to add heuristic rules in cascades....
From Chi: > yes we should do that, feel free to create an issue... > this is so-called "column name inference" > assign a name for unnamed columns, and use...
# Concept In cascades framework, physical properties have two features: - derived - required Derived are the physical properties derived from children, for example, scan from a table whose column...