spark-rapids icon indicating copy to clipboard operation
spark-rapids copied to clipboard

[FEA] Support oci:// as a cloud based filesystem

Open sameerz opened this issue 2 years ago • 3 comments

Is your feature request related to a problem? Please describe. I wish the RAPIDS Accelerator for Apache Spark would recognize the Oracle OCI filesystem for cloud reading, including it in spark.rapids.cloudSchemes

Describe the solution you'd like Reading a file from oci:// automatically sets spark.rapids.sql.format.{fileformat}.reader.type to MULTITHREADED as with other cloud schemes.

Describe alternatives you've considered Ask users on OCI to manually set spark.rapids.sql.format.{fileformat}.reader.type to MULTITHREADED

Additional context

sameerz avatar Dec 12 '22 06:12 sameerz