Jay Chia
Jay Chia
Indeed. We need a mechanism for Daft to represent tables with "no columns", but still have valid metadata. Currently the scan will naively read the first column I believe.
I believe this is because Ray didn't release wheels for 3.12! We saw this problem when debugging with some users the other day as well 😬
Ran into this today... And you all fixed it pre-emptively already :) good job!
@raunakab could you take a look and help us triage this issue?
(After offline discussion with delta-rs team) other things we might want on the roadmap that might be useful to support: 1. Variant type support 2. Row IDs
@kevinzwang should we add it into the tasks for this roadmap issue?