trino icon indicating copy to clipboard operation
trino copied to clipboard

Introduce parallelism in Iceberg `migrate` procedure

Open krvikash opened this issue 1 year ago • 6 comments

Description

Introduce parallelism in Iceberg migrate procedure

Release notes

(X) Release notes are required, with the following suggested text:

# Iceberg
* Improve performance when executing `migrate` procedure. ({issue}`16786`)

krvikash avatar Mar 29 '23 11:03 krvikash

Thanks @findinpath | @ebyhr for the review. I have addressed the comments.

krvikash avatar Apr 11 '23 09:04 krvikash

CI hits https://github.com/trinodb/trino/issues/12818

krvikash avatar Apr 11 '23 10:04 krvikash

This is definitely a good improvement for now, but it feels like we should aim for leveraging workers for this procedure if we can.

alexjo2144 avatar Apr 17 '23 15:04 alexjo2144

This pull request has gone a while without any activity. Tagging the Trino developer relations team: @bitsondatadev @colebow @mosabua

github-actions[bot] avatar Jan 17 '24 17:01 github-actions[bot]

:wave: @krvikash @alexjo2144 @ebyhr - this PR has become inactive. We hope you are still interested in working on it. Please discuss next steps such as rebase and further changes.

We're working on closing out old and inactive PRs, so if you're too busy or this has too many merge conflicts to be worth picking back up, we'll be making another pass to close it out in a few weeks.

mosabua avatar Jan 17 '24 18:01 mosabua

This pull request has gone a while without any activity. Tagging the Trino developer relations team: @bitsondatadev @colebow @mosabua

github-actions[bot] avatar Feb 09 '24 17:02 github-actions[bot]

Closing this pull request, as it has been stale for six weeks. Feel free to re-open at any time.

github-actions[bot] avatar Mar 01 '24 17:03 github-actions[bot]