Robert Pack
Robert Pack
pyarrow `Dataset`s are made up of `Fragments` (I think thats what they call them), which for us corresponds to files. These can also contain statistics, but this should already be...
superseded by #2037
> Are you able to disable them prior to writer feature checks? No, as you said, between 2 and 6 they are always enabled. The main point is that it...
> does that mean the rust writer automatically checks it? This check is done in the `commit` function, since we are also committing actions to the protocol via that function...
we should use this opportunity to also consolidate our writer implementations. right now we have one in `/writer` as well as `/operations/writer`. The one in operations being the newer one....
I'll re-open this to keep track until we have a more full-featured rust writer?
@ryanaston - of course we always happy about PRs. In this case we may have the challenge, that we need to be true to the delta protocol, which at most...
> I don't think the relevant codepath is used in by our library, so I don't think we have strong reason to take any action. I guess from my work...
this is handled.
Hi @aersam - first of all thanks for the code snipplet, it actually samed me a bit of time working on this elsewhere. In principle we always welcome contributions. In...