hadoop icon indicating copy to clipboard operation
hadoop copied to clipboard

HADOOP-19309: S3A CopyFromLocalFile operation fails when the source file does not contain file scheme

Open shameersss1 opened this issue 4 months ago • 3 comments

Description of PR

When the sourcePath does not contain any file scheme information, S3A CopyFromLocalFile operation fails. Additionally the failure is seen only when the config fs.s3a.optimized.copy.from.local.enabled is enabled (which is by default). This happens only when the local source file is given without any file scheme for example : /tmp/file.txt instead of file:///tmp/file.txt.

How was this patch tested?

Added a test case to validate the issue and the fix. Ran the testITestS3ACopyFromLocalFile in us-east-1

For code changes:

  • [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
  • [x] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
  • [x] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
  • [x] If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

shameersss1 avatar Oct 11 '24 12:10 shameersss1