feat: add robust retry/backoff for LIST/GET/HEAD

[Jay-ju]

Changes Made

Related Issues

Checklist

• [ ] Documented in API Docs (if applicable)
• [ ] Documented in User Guide (if applicable)
• [ ] If adding a new documentation page, doc is added to docs/mkdocs.yml navigation
• [ ] Documentation builds and is formatted properly

[codecov[bot]]

Codecov Report

:x: Patch coverage is 83.83838% with 16 lines in your changes missing coverage. Please review. :white_check_mark: Project coverage is 71.46%. Comparing base (c323ad0) to head (1085d95). :warning: Report is 544 commits behind head on main.

Files with missing lines	Patch %	Lines
src/daft-io/src/s3_like.rs	68.75%	10 Missing :warning:
src/daft-io/src/lib.rs	81.81%	6 Missing :warning:

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #5393      +/-   ##
==========================================
- Coverage   79.19%   71.46%   -7.73%     
==========================================
  Files         893      990      +97     
  Lines      124095   125496    +1401     
==========================================
- Hits        98279    89690    -8589     
- Misses      25816    35806    +9990     

Files with missing lines	Coverage Δ
src/daft-io/src/retry.rs	100.00% <100.00%> (+100.00%)	:arrow_up:
src/daft-io/src/lib.rs	72.76% <81.81%> (-0.61%)	:arrow_down:
src/daft-io/src/s3_like.rs	61.00% <68.75%> (-8.04%)	:arrow_down:

... and 885 files with indirect coverage changes

:rocket: New features to boost your workflow:

• :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• :package: JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

[ohbh]

@Jay-ju let us know when it's ready for review, thanks!