DIRAC icon indicating copy to clipboard operation
DIRAC copied to clipboard

Submit test Production transformation

Open fstagni opened this issue 5 months ago • 2 comments

PRE: You need to have installed the current version following the "Install a client on CC7" card and have it enabled

To-Do:

  • run script:
DIRACRepo/tests/System/transformationSystem.sh -test_filter False
  • pay attention to its log, report if broken

Then, from the client, start dirac-transformation-cli and from inside:

setStatus Flush <ID>
start <ID>

Check it back later on the web portal to see if tasks and jobs are created.

fstagni avatar Nov 20 '25 10:11 fstagni

Can not upload files:

2025-11-20T10:05:05,594450Z dirac-dms-add-file/DIRAC.Resources.Storage.StorageElement/SE[IN2P3-SE]/__executeMethod [140007252677056] DEBUG: Attempting to perform 'putFile' for 1 physical files
2025-11-20T10:05:05,594666Z dirac-dms-add-file/DIRAC.Resources.Storage.GFAL2_XROOTStorage/IN2P3-SE/GFAL2_StorageBase._putSingleFile [140007252677056] DEBUG: trying to upload ./TransformationSystemTest/Test_Transformation_System_20251120_100444_005.init to root://[email protected]//pnfs/in2p3.fr/data/dteam/diracCertification/dteam/diracCertification/Test/INIT/9.0.10.dev1+geafd9e1f2/2025-11-20/100443/Test_Transformation_System_20251120_100444_005.init
2025-11-20T10:05:05,594Z ExternalLibrary/gfal2 DEBUG:  -> Gfal::Transfer::FileCopy
2025-11-20T10:05:05,595Z ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:ENTER
2025-11-20T10:05:05,595Z ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:ITEM file:///TransformationSystemTest/Test_Transformation_System_20251120_100444_005.init => root://[email protected]//pnfs/in2p3.fr/data/dteam/diracCertification/dteam/diracCertification/Test/INIT/9.0.10.dev1+geafd9e1f2/2025-11-20/100443/Test_Transformation_System_20251120_100444_005.init
2025-11-20T10:05:05,595Z ExternalLibrary/gfal2 INFO: Event triggered: BOTH GFAL2:CORE:COPY LIST:EXIT
2025-11-20T10:05:05,595Z ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/tmp/x509up_u0
2025-11-20T10:05:05,596Z ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/tmp/x509up_u0
2025-11-20T10:05:05,596Z ExternalLibrary/gfal2 DEBUG: Copy job: tpc_only=0 tpc_delegation=1 tpc_timeout=382
2025-11-20T10:05:05,596Z ExternalLibrary/gfal2 DEBUG: Predefined Checksum Mode: end2end
2025-11-20T10:05:05,596Z ExternalLibrary/gfal2 DEBUG: Predefined Checksum Type: adler32
2025-11-20T10:05:05,596Z ExternalLibrary/gfal2 DEBUG: Predefined Checksum Value:
2025-11-20T10:05:05,597Z ExternalLibrary/gfal2 DEBUG: Impossible to get integer parameter XROOTD PLUGIN:PARALLEL_COPIES, set to default value 20, err Key file does not have key “PARALLEL_COPIES” in group “XROOTD PLUGIN”
2025-11-20T10:05:05,597Z ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:ENTER file://localhost///TransformationSystemTest/Test_Transformation_System_20251120_100444_005.init?xrd.gsiusrpxy=/tmp/x509up_u0&xrdcl.intent=tpc => root://[email protected]:1094///pnfs/in2p3.fr/data/dteam/diracCertification/dteam/diracCertification/Test/INIT/9.0.10.dev1+geafd9e1f2/2025-11-20/100443/Test_Transformation_System_20251120_100444_005.init?xrd.gsiusrpxy=/tmp/x509up_u0&xrdcl.intent=tpc
2025-11-20T10:05:05,597Z ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:TYPE streamed
2025-11-20T10:05:10,228Z ExternalLibrary/gfal2 INFO: Event triggered: BOTH xroot TRANSFER:EXIT Job finished, [ERROR] Server responded with an error: [3010] Unable to create /pnfs/in2p3.fr/data/dteam/diracCertification/dteam/diracCertification/Test/INIT/9.0.10.dev1+geafd9e1f2/2025-11-20/100443/Test_Transformation_System_20251120_100444_005.init; permission denied (destination)

2025-11-20T10:05:10,230Z ExternalLibrary/gfal2 DEBUG: Xrootd Query URI: xrd.gsiusrpxy=/tmp/x509up_u0
2025-11-20T10:05:10,237Z ExternalLibrary/gfal2 WARN: When trying to clean the destination: [gfal_xrootd_unlinkG] Failed to delete file (Permission denied)
2025-11-20T10:05:10,238Z ExternalLibrary/gfal2 INFO: Event triggered: DESTINATION xroot CLEANUP 13

my proxy:

(base) root@DEV_CLIENT $ dirac-proxy-info
subject      : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=fstagni/CN=693025/CN=Federico Stagni/CN=1237712355/CN=384131369/CN=7936063254
issuer       : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=fstagni/CN=693025/CN=Federico Stagni/CN=1237712355/CN=384131369
identity     : /DC=ch/DC=cern/OU=Organic Units/OU=Users/CN=fstagni/CN=693025/CN=Federico Stagni
timeleft     : 11:53:15
DIRAC group  : dirac_prod
DiracX       : True
path         : /tmp/x509up_u0
username     : fstagni
properties   : ProductionManagement, NormalUser, JobSharing, JobAdministrator, SiteManager, Operator, LimitedDelegation
VOMS         : True
VOMS fqan    : ['/dteam']

fstagni avatar Nov 20 '25 10:11 fstagni

Uploads were OK on UKI-SCOTGRID-GLASGOW-disk and UKI-LT2-IC-HEP-disk so issue seems to be only related to IN2P3.

fstagni avatar Nov 20 '25 10:11 fstagni