iceberg-rust icon indicating copy to clipboard operation
iceberg-rust copied to clipboard

Implement partition writer

Open ZENOTME opened this issue 1 year ago • 8 comments

Implement two partition writers:

  • [ ] fanout partition writer: partition in writer
  • [ ] partition writer: write the data already partitioned

ZENOTME avatar Apr 23 '24 03:04 ZENOTME

@liurenjie1024 , I can look into one of this task , can you please assign me ?

gupteaj avatar Apr 23 '24 16:04 gupteaj

There are rust implementation in icelake can as a reference:

  • fanout partition writer: https://github.com/icelake-io/icelake/blob/main/icelake/src/io_v2/functional_writer/partition_writer.rs
  • partition writer: https://github.com/icelake-io/icelake/blob/main/icelake/src/io_v2/functional_writer/precompute_partition_writer.rs

ZENOTME avatar Apr 24 '24 06:04 ZENOTME