incubator-xtable icon indicating copy to clipboard operation
incubator-xtable copied to clipboard

Published 20 hours ago • verified publisher icon apache

Design a system which consumes columnar file notifications from HDFS/cloud storage and generates delta, hudi and iceberg metadata

Open vinishjail97 opened this issue 4 months ago • 1 comments

Feature Request / Improvement

Sub-task of main feature request https://github.com/apache/incubator-xtable/issues/550

Look at Using cloud notifications queue in the approach mentioned below. It's only a high level approach, with many open ended items. We can do a design doc and finalize the approach through a discussion in dev mailing list. https://github.com/apache/incubator-xtable/issues/550#issuecomment-2386526797

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

vinishjail97 avatar Oct 04 '24 06:10 vinishjail97