Rok Mihevc

icon indicating a website link rok.dev icon indicating an email [email protected]

icon company Freelance icon location Amsterdam, Netherlands icon location Started as a Physicist. Open source contributor. Interested in data science and data tooling.

Results 159 comments of Rok Mihevc

GH-41719: [C++][Parquet] Cannot read encrypted parquet datasets via _metadata file

Python [error is thrown here](https://github.com/apache/arrow/blob/02585cd11249116c00fdfe0822df4ad7da790c27/python/pyarrow/dataset.py#L579-L580), but I'm not sure why.

GH-41719: [C++][Parquet] Cannot read encrypted parquet datasets via _metadata file

@wgtmac I'm not sure I follow. We already have [`WriteMetaDataFile`](https://github.com/apache/arrow/blob/02585cd11249116c00fdfe0822df4ad7da790c27/cpp/src/parquet/arrow/writer.cc#L598) to produce `_metadata` file and if we just add `WriteEncryptedMetadataFile` to produce encrypted `_metadata` files we're not really adding additional...

GH-41719: [C++][Parquet] Cannot read encrypted parquet datasets via _metadata file

Can we agree this proposal makes sense in principle? Assuming the collector can decrypt all files and encrypt them with a new key into a `_metadata` file of course.

GH-41719: [C++][Parquet] Cannot read encrypted parquet datasets via _metadata file

Thanks @ggershinsky, that's useful and encouraging!

[Python] Add video extension type

@wjones127 not sure if this should be closed.

[C++][Dataset] Preserve order when writing dataset

Issue resolved by pull request 44470 https://github.com/apache/arrow/pull/44470

AES in CTR mode?

Follow up to https://github.com/briansmith/ring/discussions/2414#discussioncomment-13120917. >It would be good to write up an outline of your planned approach, e.g. whether 96-bit nonces and 32-bit counters are sufficient or whether you intend...

AES in CTR mode?

If there's no objections I'll try to open a draft PR next week

GH-36593: [Python] Add rename_columns method to pyarrow datasets

The change looks good to me in principle. I do agree with @AlenkaF that changing `_scan_options` seems a bit forced and could have unexpected consequences elsewhere. Can you check if...