DIRAC icon indicating copy to clipboard operation
DIRAC copied to clipboard

[8.0] Change the updating logic of the TS FileStatus

Open chaen opened this issue 1 year ago • 0 comments

This aims at solving https://github.com/DIRACGrid/DIRAC/issues/7116 It is quite a big change of logic, but should not impact anybody but LHCb, as it mostly matters for complex body plugin

Also, it speeds up a lot the RequestTaskAgent. Hotfixed in LHCb, we observe a huge speedup on a transformation with 4M files:

# Before
2024-08-13 05:24:33 UTC Transformation/RequestTaskAgent/[231355] ._execute INFO: Processed transformation in 2134.9 seconds

# After
2024-08-13 09:29:19 UTC Transformation/RequestTaskAgent/[231355] ._execute INFO: Processed transformation in 62.4 seconds

BEGINRELEASENOTES *TS FIX: RequestTaskAgent only considers requests in final states, and consider files in intermediate state as problematic (https://github.com/DIRACGrid/DIRAC/issues/7116) NEW: RequestTaskAgent uses getBulkRequestStatus instead of getRequestStatus

RMS: NEW: implement getRequestStatus

ENDRELEASENOTES

chaen avatar Jul 31 '24 12:07 chaen