datafusion
datafusion copied to clipboard
Andrew Lamb Weekly-ish Open Source plan - 2025-12-08
This is my weekly plan, mostly for my own organizational needs (as I am dropping too many things). I am making it public in the hopes that helps others to see what I am working on -- also I spend so much time in github the interface is very familiar to me and I can cross link all the issues I am working
(it is also my excuse as to why I haven't reviewed many good looking PRs)
Notes to myself: a duplicate entry unchecked means I need to go back and re-review
PR review queue (rough order)
- [x] relation extension planner: https://github.com/apache/datafusion/pull/17843
- [x] https://github.com/apache/datafusion/pull/19137
- [x] https://github.com/apache/datafusion/pull/19129
- [x] https://github.com/apache/datafusion/pull/19209#pullrequestreview-3553148200
- [x] https://github.com/apache/arrow-rs/pull/8937
- [x] https://github.com/apache/datafusion/pull/19142#pullrequestreview-3553907658
- [x] https://github.com/apache/datafusion/pull/18868
- [x] https://github.com/apache/datafusion/pull/19050
- [x] https://github.com/apache/datafusion/pull/19128
- [x] https://github.com/apache/datafusion/pull/18789
- [x] https://github.com/apache/datafusion/pull/19054
- [ ] https://github.com/apache/datafusion/pull/19111
- [ ] https://github.com/apache/datafusion/pull/19064
- [ ] https://github.com/apache/datafusion/pull/19108
- [ ] https://github.com/apache/arrow-rs/pull/8953
- [ ] https://github.com/apache/arrow-rs/pull/8951
- [ ] https://github.com/apache/datafusion/pull/18832
- [ ] https://github.com/apache/datafusion/pull/18868 (rereview)
- [ ] https://github.com/apache/datafusion/pull/18817
- [ ] https://github.com/apache/datafusion/pull/18906
- [ ] https://github.com/apache/arrow-rs/pull/8918#issuecomment-3576429777
- [ ] https://github.com/apache/datafusion/pull/18552
- [ ] https://github.com/apache/datafusion/pull/17915
Projects I am supporting actively (high on my priority list)
- [ ] Improve DataFusion ClickBench performance: https://github.com/apache/datafusion/issues/18489
- [ ] Release object store 0.13.0: https://github.com/apache/arrow-rs-object-store/issues/367
- [ ] DataFusion object store requests go faster with @BlakeOrth https://github.com/apache/datafusion/issues/17214
- [ ] Help integrate Variant with @friendlymatthew https://github.com/apache/datafusion/issues/16116
Projects on my backlog
These are ones I would like to support but don't have the capacity at the moment to push, in relative order
- [ ] https://github.com/apache/datafusion/issues/18249 from @NGA-TRAN
- [ ] https://github.com/apache/datafusion/pull/18535
PRs that look great but need a thorough review (looking for help here 🎣 from anyone else)
- [ ] external tables for multiple locations: https://github.com/apache/datafusion/pull/17702
- [ ] writing REE arrays to parquet: https://github.com/apache/arrow-rs/pull/8069