fluent-plugin-azurestorage icon indicating copy to clipboard operation
fluent-plugin-azurestorage copied to clipboard

Published 20 hours ago • verified publisher icon htgc

Support for Parquet Format

Open Athishpranav2003 opened this issue 1 year ago • 5 comments
trafficstars

This is addressing the enhancement requested in #28 . Since S3 plugin has mentioned about pluggable compression methods, this should also be mentioned in the README. I hope this repo is still maintained😅

Athishpranav2003 avatar May 29 '24 05:05 Athishpranav2003

@htgc ping

Athishpranav2003 avatar Jul 15 '24 12:07 Athishpranav2003

@cosmo0920 could you please check this

Athishpranav2003 avatar Aug 05 '24 10:08 Athishpranav2003

@kenhys @daipom @ashie Do you guys have a cycle to take a look on this?

cosmo0920 avatar Aug 05 '24 11:08 cosmo0920

I'm not sure but, it seems that supported compression codec is a bit different.

https://learn.microsoft.com/en-us/azure/data-factory/format-parquet

Am I missing the point?

kenhys avatar Aug 16 '24 09:08 kenhys

This plugins seems to be used for Azure Blob: https://github.com/htgc/fluent-plugin-azurestorage/blob/master/lib/fluent/plugin/out_azurestorage.rb#L98

cosmo0920 avatar Aug 16 '24 15:08 cosmo0920