lakeFS
lakeFS copied to clipboard
Prefetch commits in Graveler ListCommits
ListCommits is capable of scanning thousands of commits, but it does so serially. It's better to prefetch the commit, metarange and range to parallelize the download from S3 which becomes the bottleneck.