icelake icon indicating copy to clipboard operation
icelake copied to clipboard

iceberg spec requires to store absolute path of file

Open Xuanwo opened this issue 2 years ago • 1 comments

          Yes, the iceberg spec requires to store absolute path of file. "s3a" can be recognized by hdfs client while "s3" can't, so the be best compatible with other systems, we should keep it.

Originally posted by @liurenjie1024 in https://github.com/icelake-io/icelake/pull/118#discussion_r1280491927

Xuanwo avatar Aug 01 '23 11:08 Xuanwo

OpenDAL will normalize all s3 alike services to s3, but hdfs and other java implementations not.

Xuanwo avatar Aug 01 '23 11:08 Xuanwo

Closing for https://github.com/icelake-io/icelake/issues/279

Xuanwo avatar Jul 09 '24 10:07 Xuanwo