pegasus icon indicating copy to clipboard operation
pegasus copied to clipboard

[PM-825] Default output mapper strips trailing / from LFN when it generates the URL

Open mayani opened this issue 1 year ago • 3 comments

Now that pegasus-transfer can handle output directories in addition to output files, we want to use LFNs with a trailing slash so that we get the correct GridFTP URLs. If a directory is to be transferred, globus-url-copy requires both the source and the destination URLs to end with a '/'. Right now the default output mapper strips the trailing '/', so that the destination URL in the .in file for pegasus-transfer does not end in '/'.

What we should really do is treat directories differently in the DAX, and have the planner mark them as such and generate URLs more carefully. For now I am using the fixed mapper and it retains the '/'.

Reporter: @juve Watchers: @juve @vahi

mayani avatar Dec 14 '24 03:12 mayani

Author: @vahi

this should be considered for 4.6 with appropriate DAX changes

mayani avatar Dec 14 '24 14:12 mayani

Author: @vahi

we should consider this for next major release

mayani avatar Dec 14 '24 14:12 mayani

we should discuss whether we want to support this or not.

vahi avatar May 15 '25 20:05 vahi

g-u-c/gsi is deprecated. Won't fix.

rynge avatar Aug 22 '25 18:08 rynge