lakeFS icon indicating copy to clipboard operation
lakeFS copied to clipboard

Published 20 hours ago • verified publisher icon treeverse

Support lakeFS-specific Hadoop filesystem on Hadoop 3

Open talSofer opened this issue 3 years ago • 0 comments

Currently, lakeFSFS support Hadoop 2, and we need to add support for Hadoop 3.

DOD:

  • Hadoop 3 spec tests pass
  • lakeFSFS depends only on matching Hadoop packages.
  • A client is published to maven central
  • There are integration tests for Hadoop 3 and Spark 3.x (TBD exact Spark versions) combinations.
  • lakeFSFS for Hadoop 2 working without a regression.

talSofer avatar Aug 09 '22 13:08 talSofer