DataFed icon indicating copy to clipboard operation
DataFed copied to clipboard

Add retries as option when working with data transfers

Open JoshuaSBrown opened this issue 2 years ago • 2 comments

Description

In the face of network faults, DataFed is canceling tasks. This needs to be controlled with an option. Instead, the default Globus behavior should be used, if a user specifically wants to cancel a transfer after a determined number of faults that is an option they can specify. This is particularly important when first testing a repository and attempting to detect network errors, but it is also useful to cancel tasks early in cases where there is high network traffic and an alternative transfer request to a different Globus endpoint might be preferable.

Tasks

  • [x] - Upgrade version
  • [ ] - Changelog comment
  • [ ] - Add tests
  • [ ] - Feature description
  • [ ] - Working tests in ci
  • [ ] - Formatting passes
  • [ ] - Documentation added
  • [x] - Add labels
  • [ ] - Assign work
  • [x] - Assign expected time

Work time

Expected time: 24 hours

JoshuaSBrown avatar Nov 03 '23 02:11 JoshuaSBrown

Still need to address the faults logic in the GlobusAPI.cpp file and update the documentation. Also need to update the web server to support a retries parameter.

JoshuaSBrown avatar Nov 03 '23 04:11 JoshuaSBrown

@par-hermes format

JoshuaSBrown avatar Nov 08 '23 16:11 JoshuaSBrown

Not configurable, creates problems

AronPerez avatar May 12 '25 14:05 AronPerez