iceberg-python icon indicating copy to clipboard operation
iceberg-python copied to clipboard

Refactor pyarrow to look like fsspec

Open kevinjqliu opened this issue 1 year ago • 0 comments

Addresses #310 Consolidate FileIO

TODO:

  • Figure out what to do about HadoopFileSystem.from_uri(f"hdfs://{netloc}")
  • Get rid of parse_location
  • Pushdown similar function to io/__init__.py as much as possible

kevinjqliu avatar Feb 06 '24 00:02 kevinjqliu