stocator
stocator copied to clipboard
Double slash in COS parquet path is being added
The parquet files are failing during rename operation because of double slash (//) in the path. This has occurred after merging https://github.com/CODAIT/stocator/issues/318
Solution: The rename for spark-events flow should be made conditional and the existing code is made default. handle rename differently for eventlog appstatus files
if (pathToKey(src).endsWith(".inprogress")) {
// changed logic if the 'rename' method is called on file ending ".inprogress" (this will be appstatus file)
...
} else {
// existing code
}
Test Results updated here