lakeFS icon indicating copy to clipboard operation
lakeFS copied to clipboard

Prefetch commits in Graveler ListCommits

Open itaiad200 opened this issue 2 years ago • 0 comments

ListCommits is capable of scanning thousands of commits, but it does so serially. It's better to prefetch the commit, metarange and range to parallelize the download from S3 which becomes the bottleneck.

itaiad200 avatar Aug 22 '22 13:08 itaiad200