lakeFS icon indicating copy to clipboard operation
lakeFS copied to clipboard

Published 20 hours ago • verified publisher icon treeverse

Esti MinIO GC test

Open arielshaqed opened this issue 2 years ago • 3 comments

Follow-on #4795 by adding MinIO testing to Esti.

Open questions include:

  • How to test on Spark 2.4.7 -- will need Hadoop >= 2.8 just to support MinIO.
  • Can we test more than one fairly trivial Spark / lakeFS / MinIO configuration?

arielshaqed avatar Dec 27 '22 16:12 arielshaqed

Decisions with @talSofer:

  • [ ] Start by testing Spark 3 / Hadoop 3.
  • [ ] Test Spark 3 / Hadoop 2 by using host-style addressing and giving per-bucket names on Docker.
  • [ ] Decide whether to test Spark 2 / Hadoop 2 later.

arielshaqed avatar Jan 02 '23 08:01 arielshaqed

This issue is now marked as stale after 90 days of inactivity, and will be closed soon. To keep it, mark it with the "no stale" label.

github-actions[bot] avatar Nov 01 '23 14:11 github-actions[bot]

Still needed to give first-class support to MinIO.

arielshaqed avatar Nov 05 '23 13:11 arielshaqed