hadoop
hadoop copied to clipboard
HADOOP-19309: S3A CopyFromLocalFile operation fails when the source file does not contain file scheme
Description of PR
When the sourcePath does not contain any file scheme information, S3A CopyFromLocalFile operation fails. Additionally the failure is seen only when the config fs.s3a.optimized.copy.from.local.enabled
is enabled (which is by default). This happens only when the local source file is given without any file scheme for example : /tmp/file.txt
instead of file:///tmp/file.txt.
How was this patch tested?
Added a test case to validate the issue and the fix. Ran the testITestS3ACopyFromLocalFile
in us-east-1
For code changes:
- [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
- [x] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
- [x] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
- [x] If applicable, have you updated the
LICENSE
,LICENSE-binary
,NOTICE-binary
files?