Robert Pack

Results 141 comments of Robert Pack

pyarrow `Dataset`s are made up of `Fragments` (I think thats what they call them), which for us corresponds to files. These can also contain statistics, but this should already be...

> Are you able to disable them prior to writer feature checks? No, as you said, between 2 and 6 they are always enabled. The main point is that it...

> does that mean the rust writer automatically checks it? This check is done in the `commit` function, since we are also committing actions to the protocol via that function...

we should use this opportunity to also consolidate our writer implementations. right now we have one in `/writer` as well as `/operations/writer`. The one in operations being the newer one....

I'll re-open this to keep track until we have a more full-featured rust writer?

@ryanaston - of course we always happy about PRs. In this case we may have the challenge, that we need to be true to the delta protocol, which at most...

> I don't think the relevant codepath is used in by our library, so I don't think we have strong reason to take any action. I guess from my work...

Hi @aersam - first of all thanks for the code snipplet, it actually samed me a bit of time working on this elsewhere. In principle we always welcome contributions. In...