community
community copied to clipboard
[INS-2200] [Feature] Parquet Operator
Is There an Existing Issue for This?
- [X] I have searched the existing issues
Project
Instill VDP
Is your Proposal Related to a Problem?
No, it is a new feature request.
Describe Your Proposed Solution
We can have an operator to extract/query data from Apache Parquet file, and write data (maybe JSON data) to it.
Highlight the Benefits
VDP will have support for working with Parquet format.
Anything Else?
Reference - https://pkg.go.dev/github.com/apache/arrow/go/parquet
https://github.com/xitongsys/parquet-go