Will Jones
Will Jones
FYI I fixed the upstream casting issue. I will be available in PyArrow 10.0.0, which will be released in the next couple weeks.
@pitrou Are we still trying to get this into 10.0.0? Or can this be bumped to 11.0.0? I can work on this regardless.
Closing in favor of #14638
> I think this should be raised in the mailing list - this is a non-trivial change to the spec - afaik internal names are an integral part of the...
@pitrou @paleolimbot Would you be willing to review?
@tdas gentle ping. It sounds like Spark does indeed still use invariants for NOT NULL columns, based on this conversation: https://delta-users.slack.com/archives/CJ70UCSHM/p1693348327628349 So maybe instead of deprecated the use case should...
FYI I'm planning on reviewing this weekend. :)
I am realizing we have another transaction implementation called `DeltaTransaction`, which is what we are currently using in Python. This improved implementation doesn't seem to have a low-level API where...
We aren't working on this, and might never implement this. Copying from another discussion where I explained why we didn't peruse this: > We don't write the log files with...
> Any news ? I'm also wondering to use this repo to save production data in delta table on S3. Right now I'd call it Beta-supported right now. We've implemented...