WMCore Status: 400 Reason: Bad Request

A voice from the past ...

at around 2025-03-05 12:07:50 today, there was a rejected submission with

Status: 400 Reason: Bad Request\nExplanation:\n<!DOCTYPE html PUBLIC\n"-//W3C//DTD XHTML 1.0 Transitional//EN"\n"[http: //www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">\n<html>\n<head>\n](http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd) <meta http-equiv="Content-Type" content="text/html; charset=utf-8"></meta>\n <title>400 Bad Request</title>\n <style type="text/css">\n #powered_by {\n margin-top: 20px;\n border-top: 2px solid black;\n font-style: italic;\n }\n\n #traceback {\n color: red;\n }\n </style>\n</head>\n <body>\n <h2>400 Bad Request</h2>\n <p>Invalid spec parameter value: int() argument must be a string, a bytes-like object or a number, not 'NoneType'</p>\n <pre id="traceback"></pre>\n <div id="powered_by">\n <span>\n Powered by <a href="[http: //www.cherrypy.dev">CherryPy](http://www.cherrypy.dev/) 18.8.0</a>\n </span>\n </div>\n </body>\n</html>

has an answer (I thought we'd be far along now providing the name of the argument that fails schema check ...)

The document that was posted is

{
    "RequestType": "TaskChain",
    "Group": "ppd",
    "Requestor": "pdmvserv",
    "TaskChain": 5,
    "ProcessingVersion": 1,
    "RequestPriority": 90000,
    "SubRequestType": "ReDigi",
    "Multicore": 1,
    "Task1": {
        "TaskName": "EXO-Run3Summer22EEwmLHEGS-03802_0",
        "KeepOutput": false,
        "ConfigCacheID": "da745874e2da7c12dc31cce7a750d2c6",
        "GlobalTag": "124X_mcRun3_2022_realistic_postEE_v1",
        "CMSSWVersion": "CMSSW_12_4_20",
        "ScramArch": "el8_amd64_gcc10",
        "PrimaryDataset": "WplusH_Hto2Sto4Tau_ctauS-1000_MH-125_MS-40_TuneCP5_13p6TeV_powheg-pythia8",
        "AcquisitionEra": "Run3Summer22EEwmLHEGS",
        "Campaign": "Run3Summer22EEwmLHEGS",
        "ProcessingString": "124X_mcRun3_2022_realistic_postEE_v1",
        "TimePerEvent": 25.229016396337755,
        "SizePerEvent": 639.2340317460317,
        "Memory": 3000,
        "FilterEfficiency": 1,
        "PrepID": "EXO-Run3Summer22EEwmLHEGS-03802",
        "Multicore": 8,
        "SplittingAlgo": "EventBased",
        "RequestNumEvents": 37500,
        "Seeding": "AutomaticSeeding",
        "EventsPerLumi": 1000.0,
        "LheInputFiles": false
    },
    "Task2": {
        "TaskName": "EXO-Run3Summer22EEDRPremix-03175_0",
        "KeepOutput": false,
        "ConfigCacheID": "da745874e2da7c12dc31cce7a74bdea3",
        "GlobalTag": "124X_mcRun3_2022_realistic_postEE_v1",
        "CMSSWVersion": "CMSSW_12_4_16",
        "ScramArch": "el8_amd64_gcc10",
        "PrimaryDataset": "WplusH_Hto2Sto4Tau_ctauS-1000_MH-125_MS-40_TuneCP5_13p6TeV_powheg-pythia8",
        "AcquisitionEra": "Run3Summer22EEDRPremix",
        "Campaign": "Run3Summer22EEDRPremix",
        "ProcessingString": "124X_mcRun3_2022_realistic_postEE_v1",
        "TimePerEvent": 30,
        "SizePerEvent": 1200,
        "Memory": 7000,
        "FilterEfficiency": 1.0,
        "PrepID": "EXO-Run3Summer22EEDRPremix-03175",
        "Multicore": 4,
        "MCPileup": "/Neutrino_E-10_gun/Run3Summer21PrePremix-Summer22_124X_mcRun3_2022_realistic_v11-v2/PREMIX",
        "SplittingAlgo": "EventAwareLumiBased",
        "InputFromOutputModule": "RAWSIMoutput",
        "InputTask": "EXO-Run3Summer22EEwmLHEGS-03802_0"
    },
    "Task3": {
        "TaskName": "EXO-Run3Summer22EEDRPremix-03175_1",
        "KeepOutput": true,
        "ConfigCacheID": "da745874e2da7c12dc31cce7a74bed36",
        "GlobalTag": "124X_mcRun3_2022_realistic_postEE_v1",
        "CMSSWVersion": "CMSSW_12_4_16",
        "ScramArch": "el8_amd64_gcc10",
        "PrimaryDataset": "WplusH_Hto2Sto4Tau_ctauS-1000_MH-125_MS-40_TuneCP5_13p6TeV_powheg-pythia8",
        "AcquisitionEra": "Run3Summer22EEDRPremix",
        "Campaign": "Run3Summer22EEDRPremix",
        "ProcessingString": "124X_mcRun3_2022_realistic_postEE_v1",
        "TimePerEvent": 6,
        "SizePerEvent": 550,
        "Memory": 7000,
        "FilterEfficiency": 1.0,
        "PrepID": "EXO-Run3Summer22EEDRPremix-03175",
        "Multicore": 4,
        "MCPileup": "/Neutrino_E-10_gun/Run3Summer21PrePremix-Summer22_124X_mcRun3_2022_realistic_v11-v2/PREMIX",
        "SplittingAlgo": "EventAwareLumiBased",
        "InputFromOutputModule": "PREMIXRAWoutput",
        "InputTask": "EXO-Run3Summer22EEDRPremix-03175_0"
    },
    "Task4": {
        "TaskName": "EXO-Run3Summer22EEMiniAODv4-03055_0",
        "KeepOutput": true,
        "ConfigCacheID": "da745874e2da7c12dc31cce7a74bf452",
        "GlobalTag": "130X_mcRun3_2022_realistic_postEE_v6",
        "CMSSWVersion": "CMSSW_13_0_13",
        "ScramArch": "el8_amd64_gcc11",
        "PrimaryDataset": "WplusH_Hto2Sto4Tau_ctauS-1000_MH-125_MS-40_TuneCP5_13p6TeV_powheg-pythia8",
        "AcquisitionEra": "Run3Summer22EEMiniAODv4",
        "Campaign": "Run3Summer22EEMiniAODv4",
        "ProcessingString": "130X_mcRun3_2022_realistic_postEE_v6",
        "TimePerEvent": 1,
        "SizePerEvent": 150,
        "Memory": 7000,
        "FilterEfficiency": 1.0,
        "PrepID": "EXO-Run3Summer22EEMiniAODv4-03055",
        "Multicore": 4,
        "SplittingAlgo": "EventAwareLumiBased",
        "InputFromOutputModule": "AODSIMoutput",
        "InputTask": "EXO-Run3Summer22EEDRPremix-03175_1"
    },
    "Task5": {
        "TaskName": "EXO-Run3Summer22EENanoAODv12-02753_0",
        "KeepOutput": true,
        "ConfigCacheID": "da745874e2da7c12dc31cce7a74c0052",
        "GlobalTag": "130X_mcRun3_2022_realistic_postEE_v6",
        "CMSSWVersion": "CMSSW_13_0_13",
        "ScramArch": "el8_amd64_gcc11",
        "PrimaryDataset": "WplusH_Hto2Sto4Tau_ctauS-1000_MH-125_MS-40_TuneCP5_13p6TeV_powheg-pythia8",
        "AcquisitionEra": "Run3Summer22EENanoAODv12",
        "Campaign": "Run3Summer22EENanoAODv12",
        "ProcessingString": "130X_mcRun3_2022_realistic_postEE_v6",
        "TimePerEvent": 0.3402,
        "SizePerEvent": 30.782,
        "Memory": 8000,
        "FilterEfficiency": 1.0,
        "PrepID": "EXO-Run3Summer22EENanoAODv12-02753",
        "Multicore": 4,
        "SplittingAlgo": "EventAwareLumiBased",
        "InputFromOutputModule": "MINIAODSIMoutput",
        "InputTask": "EXO-Run3Summer22EEMiniAODv4-03055_0"
    },
    "CMSSWVersion": "CMSSW_13_0_13",
    "ScramArch": "el8_amd64_gcc11",
    "TimePerEvent": 0.3402,
    "SizePerEvent": 30.782,
    "GlobalTag": "130X_mcRun3_2022_realistic_postEE_v6",
    "Memory": 8000,
    "AcquisitionEra": "Run3Summer22EEwmLHEGS",
    "ProcessingString": "124X_mcRun3_2022_realistic_postEE_v1",
    "Campaign": "Run3Summer22EEwmLHEGS",
    "PrepID": "task_EXO-Run3Summer22EEwmLHEGS-03802",
    "RequestString": "task_EXO-Run3Summer22EEwmLHEGS-03802__v1_T",
    "DbsUrl": "https://cmsweb.cern.ch/dbs/prod/global/DBSReader/",
    "ConfigCacheUrl": "https://cmsweb.cern.ch/couchdb"
}

which looks pretty legit to me, in particular because retrying an hour later succeeded.

Mar 05 '25 13:03 vlimant

Logs from ReqMgr around the given timestamp,

reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-[05/Mar/2025:11:07:31]  Error: Traceback (most recent call last):
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-  File "/usr/local/lib/python3.8/site-packages/WMCore/ReqMgr/Service/Request.py", line 213, in validate
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-    self._validateRequestBase(param, safe, validate_request_create_args)
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-  File "/usr/local/lib/python3.8/site-packages/WMCore/ReqMgr/Service/Request.py", line 106, in _validateRequestBase
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-    workload, r_args = valFunc(args, self.config, self.reqmgr_db_service, param)
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-  File "/usr/local/lib/python3.8/site-packages/WMCore/ReqMgr/Utils/Validation.py", line 159, in validate_request_create_args
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-    workload = spec.factoryWorkloadConstruction(request_args["RequestName"],
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-  File "/usr/local/lib/python3.8/site-packages/WMCore/WMSpec/StdSpecs/StdBase.py", line 924, in factoryWorkloadConstruction
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-    workload = self.__call__(workloadName=workloadName, arguments=arguments)
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-  File "/usr/local/lib/python3.8/site-packages/WMCore/WMSpec/StdSpecs/TaskChain.py", line 283, in __call__
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-    self.setupTask(task, taskConf)
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-  File "/usr/local/lib/python3.8/site-packages/WMCore/WMSpec/StdSpecs/TaskChain.py", line 157, in __call__
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-    self.func(self.obj, task, taskConf)
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-  File "/usr/local/lib/python3.8/site-packages/WMCore/WMSpec/StdSpecs/TaskChain.py", line 492, in setupTask
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-    outputMods = self.setupProcessingTask(task, "Processing",
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-  File "/usr/local/lib/python3.8/site-packages/WMCore/WMSpec/StdSpecs/StdBase.py", line 390, in setupProcessingTask
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-    procTask.setProcessingVersion(procVer)
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-  File "/usr/local/lib/python3.8/site-packages/WMCore/WMSpec/WMTask.py", line 1393, in setProcessingVersion
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-    self.data.parameters.processingVersion = int(taskProcVer)
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log:TypeError: int() argument must be a string, a bytes-like object or a number, not 'NoneType'
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log:[05/Mar/2025:11:07:31]  SERVER REST ERROR WMCore.ReqMgr.DataStructs.RequestError.InvalidSpecParameterValue 9204fb3f16ca56a713732112854ebca3 (Invalid spec parameter value: int() argument must be a string, a bytes-like object or a number, not 'NoneType')
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-[05/Mar/2025:11:07:31]    Traceback (most recent call last):
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-[05/Mar/2025:11:07:31]      File "/usr/local/lib/python3.8/site-packages/WMCore/REST/Server.py", line 749, in default
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-[05/Mar/2025:11:07:31]        return self._call(RESTArgs(list(args), kwargs))
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-[05/Mar/2025:11:07:31]      File "/usr/local/lib/python3.8/site-packages/WMCore/REST/Server.py", line 828, in _call
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-[05/Mar/2025:11:07:31]        v(apiobj, request.method, api, param, safe)
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-[05/Mar/2025:11:07:31]      File "/usr/local/lib/python3.8/site-packages/WMCore/ReqMgr/Service/Request.py", line 229, in validate
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log-[05/Mar/2025:11:07:31]        raise InvalidSpecParameterValue(msg) from None
reqmgr2-20250305-reqmgr2-79899bb4dd-pttbb.log:[05/Mar/2025:11:07:31]    WMCore.ReqMgr.DataStructs.RequestError.InvalidSpecParameterValue: InvalidSpecParameterValue 9204fb3f16ca56a713732112854ebca3 [HTTP 400, APP 1102, MSG "Invalid spec parameter value: int() argument must be a string, a bytes-like object or a number, not 'NoneType'", INFO None, ERR None]

Mar 05 '25 13:03 hassan11196

would it be "ProcessingVersion": 1, that made it fail ?

Mar 18 '25 16:03 vlimant

this is happening from time to time and sleep+retries are not sufficient apparently. while wait an hour and try does. so something on the receiving end is off.

Apr 18 '25 07:04 vlimant

I guess we will have to live with the instability

May 09 '25 07:05 vlimant

also https://github.com/dmwm/WMCore/issues/8897

Oct 13 '25 11:10 vlimant

Today, we experienced the following issue while attempting to inject some requests:

Will do POST request to: cmsweb.cern.ch/reqmgr2/data/request
could not post request with following parameters:
{
    "RequestType": "TaskChain",
    "Group": "ppd",
    "Requestor": "pdmvserv",
    "TaskChain": 5,
    "ProcessingVersion": 1,
    "RequestPriority": 90000,
    "SubRequestType": "ReDigi",
    "Multicore": 1,
    "Task1": {
        "TaskName": "EXO-RunIII2024Summer24HSCPGS-00029_0",
        "KeepOutput": false,
        "ConfigCacheID": "474d64cb9020da17bd0de3285466bf20",
        "GlobalTag": "140X_mcRun3_2024_realistic_v26",
        "CMSSWVersion": "CMSSW_14_0_21_patch4",
        "ScramArch": "el8_amd64_gcc12",
        "PrimaryDataset": "HSCP-TauPrime_Par-Q-1e-M-2200_TuneCP5_13p6TeV_pythia8",
        "AcquisitionEra": "RunIII2024Summer24HSCPGS",
        "Campaign": "RunIII2024Summer24HSCPGS",
        "ProcessingString": "140X_mcRun3_2024_realistic_v26",
        "TimePerEvent": 1.323528633218451,
        "SizePerEvent": 540.350391959799,
        "Memory": 4000,
        "FilterEfficiency": 1.0,
        "PrepID": "EXO-RunIII2024Summer24HSCPGS-00029",
        "Multicore": 8,
        "SplittingAlgo": "EventBased",
        "RequestNumEvents": 100000,
        "Seeding": "AutomaticSeeding",
        "EventsPerLumi": 1000.0,
        "LheInputFiles": false
    },
    "Task2": {
        "TaskName": "EXO-RunIII2024Summer24DRPremix-02185_0",
        "KeepOutput": false,
        "ConfigCacheID": "f72e3f8dd1790ef2c2b699e5bb7b3832",
        "GlobalTag": "140X_mcRun3_2024_realistic_v26",
        "CMSSWVersion": "CMSSW_14_0_21_patch4",
        "ScramArch": "el8_amd64_gcc12",
        "PrimaryDataset": "HSCP-TauPrime_Par-Q-1e-M-2200_TuneCP5_13p6TeV_pythia8",
        "AcquisitionEra": "RunIII2024Summer24DRPremix",
        "Campaign": "RunIII2024Summer24DRPremix",
        "ProcessingString": "140X_mcRun3_2024_realistic_v26",
        "TimePerEvent": 30,
        "SizePerEvent": 1200,
        "Memory": 8000,
        "FilterEfficiency": 1.0,
        "PrepID": "EXO-RunIII2024Summer24DRPremix-02185",
        "Multicore": 4,
        "MCPileup": "/Neutrino_E-10_gun/RunIIISummer24PrePremix-Premixlib2024_140X_mcRun3_2024_realistic_v26-v1/PREMIX",
        "SplittingAlgo": "EventAwareLumiBased",
        "InputFromOutputModule": "RAWSIMoutput",
        "InputTask": "EXO-RunIII2024Summer24HSCPGS-00029_0"
    },
    "Task3": {
        "TaskName": "EXO-RunIII2024Summer24DRPremix-02185_1",
        "KeepOutput": true,
        "ConfigCacheID": "f72e3f8dd1790ef2c2b699e5bb7b417e",
        "GlobalTag": "140X_mcRun3_2024_realistic_v26",
        "CMSSWVersion": "CMSSW_14_0_21_patch4",
        "ScramArch": "el8_amd64_gcc12",
        "PrimaryDataset": "HSCP-TauPrime_Par-Q-1e-M-2200_TuneCP5_13p6TeV_pythia8",
        "AcquisitionEra": "RunIII2024Summer24DRPremix",
        "Campaign": "RunIII2024Summer24DRPremix",
        "ProcessingString": "140X_mcRun3_2024_realistic_v26",
        "TimePerEvent": 6,
        "SizePerEvent": 550,
        "Memory": 8000,
        "FilterEfficiency": 1.0,
        "PrepID": "EXO-RunIII2024Summer24DRPremix-02185",
        "Multicore": 4,
        "MCPileup": "/Neutrino_E-10_gun/RunIIISummer24PrePremix-Premixlib2024_140X_mcRun3_2024_realistic_v26-v1/PREMIX",
        "SplittingAlgo": "EventAwareLumiBased",
        "InputFromOutputModule": "PREMIXRAWoutput",
        "InputTask": "EXO-RunIII2024Summer24DRPremix-02185_0"
    },
    "Task4": {
        "TaskName": "EXO-RunIII2024Summer24MiniAODv6-02035_0",
        "KeepOutput": true,
        "ConfigCacheID": "f72e3f8dd1790ef2c2b699e5bb7b7947",
        "GlobalTag": "150X_mcRun3_2024_realistic_v2",
        "CMSSWVersion": "CMSSW_15_0_15",
        "ScramArch": "el8_amd64_gcc12",
        "PrimaryDataset": "HSCP-TauPrime_Par-Q-1e-M-2200_TuneCP5_13p6TeV_pythia8",
        "AcquisitionEra": "RunIII2024Summer24MiniAODv6",
        "Campaign": "RunIII2024Summer24MiniAODv6",
        "ProcessingString": "150X_mcRun3_2024_realistic_v2",
        "TimePerEvent": 1,
        "SizePerEvent": 150,
        "Memory": 8000,
        "FilterEfficiency": 1.0,
        "PrepID": "EXO-RunIII2024Summer24MiniAODv6-02035",
        "Multicore": 4,
        "SplittingAlgo": "EventAwareLumiBased",
        "InputFromOutputModule": "AODSIMoutput",
        "InputTask": "EXO-RunIII2024Summer24DRPremix-02185_1"
    },
    "Task5": {
        "TaskName": "EXO-RunIII2024Summer24NanoAODv15-02035_0",
        "KeepOutput": true,
        "ConfigCacheID": "f72e3f8dd1790ef2c2b699e5bb7b7bac",
        "GlobalTag": "150X_mcRun3_2024_realistic_v2",
        "CMSSWVersion": "CMSSW_15_0_15",
        "ScramArch": "el8_amd64_gcc12",
        "PrimaryDataset": "HSCP-TauPrime_Par-Q-1e-M-2200_TuneCP5_13p6TeV_pythia8",
        "AcquisitionEra": "RunIII2024Summer24NanoAODv15",
        "Campaign": "RunIII2024Summer24NanoAODv15",
        "ProcessingString": "150X_mcRun3_2024_realistic_v2",
        "TimePerEvent": 0.3,
        "SizePerEvent": 30,
        "Memory": 8000,
        "FilterEfficiency": 1.0,
        "PrepID": "EXO-RunIII2024Summer24NanoAODv15-02035",
        "Multicore": 4,
        "SplittingAlgo": "EventAwareLumiBased",
        "InputFromOutputModule": "MINIAODSIM1output",
        "InputTask": "EXO-RunIII2024Summer24MiniAODv6-02035_0"
    },
    "CMSSWVersion": "CMSSW_15_0_15",
    "ScramArch": "el8_amd64_gcc12",
    "TimePerEvent": 0.3,
    "SizePerEvent": 30,
    "GlobalTag": "150X_mcRun3_2024_realistic_v2",
    "Memory": 8000,
    "AcquisitionEra": "RunIII2024Summer24HSCPGS",
    "ProcessingString": "140X_mcRun3_2024_realistic_v26",
    "Campaign": "RunIII2024Summer24HSCPGS",
    "PrepID": "task_EXO-RunIII2024Summer24HSCPGS-00029",
    "RequestString": "task_EXO-RunIII2024Summer24HSCPGS-00029__v1_T",
    "DbsUrl": "https://cmsweb.cern.ch/dbs/prod/global/DBSReader/",
    "ConfigCacheUrl": "https://cmsweb.cern.ch/couchdb"
}

Response from http call:
Status: 400 Reason: Bad Request
Explanation:
<!DOCTYPE html PUBLIC
"-//W3C//DTD XHTML 1.0 Transitional//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
<html>
<head>
    <meta http-equiv="Content-Type" content="text/html; charset=utf-8"></meta>
    <title>400 Bad Request</title>
    <style type="text/css">
    #powered_by {
        margin-top: 20px;
        border-top: 2px solid black;
        font-style: italic;
    }

    #traceback {
        color: red;
    }
    </style>
</head>
    <body>
        <h2>400 Bad Request</h2>
        <p>Invalid spec parameter value: &lt;@========== WMException Start ==========@&gt;
Exception Class: WMSpecFactoryException
Message: DBSReaderError
Message: Error in DBS server is not up: https://cmsweb-prod.cern.ch/dbs/prod/global/DBSReaderHTTPError:HTTP Error 503:
URL=https://cmsweb-prod.cern.ch:8443/dbs/prod/global/DBSReader/serverinfo
Code=503
Message=
Header=HTTP/2 503
content-type: text/html
date: Thu, 06 Nov 2025 09:54:43 GMT
response-proto: HTTP/1.1
response-status: 503 Service Temporarily Unavailable
response-status-code: 503
response-time: 4.033045ms
response-time-seconds: 0.004033512
x-content-type-options: bla
content-length: 190


Body=&lt;html&gt;
&lt;head&gt;&lt;title&gt;503 Service Temporarily Unavailable&lt;/title&gt;&lt;/head&gt;
&lt;body&gt;
&lt;center&gt;&lt;h1&gt;503 Service Temporarily Unavailable&lt;/h1&gt;&lt;/center&gt;
&lt;hr&gt;&lt;center&gt;nginx&lt;/center&gt;
&lt;/body&gt;
&lt;/html&gt;



        ClassName : None
        ModuleName : WMCore.Services.DBS.DBSErrors
        MethodName : __init__
        ClassInstance : None
        FileName : /usr/local/lib/python3.12/site-packages/WMCore/Services/DBS/DBSErrors.py
        LineNumber : 42
        ErrorNr : 1002

        ClassName : None
        ModuleName : WMCore.WMSpec.WMWorkloadTools
        MethodName : _validateArgFunction
        ClassInstance : None
        FileName : /usr/local/lib/python3.12/site-packages/WMCore/WMSpec/WMWorkloadTools.py
        LineNumber : 151
        ErrorNr : 0

Traceback:
  File "/usr/local/lib/python3.12/site-packages/WMCore/WMSpec/WMWorkloadTools.py", line 142, in _validateArgFunction
    if not valFunction(value):
           ^^^^^^^^^^^^^^^^^^

  File "/usr/local/lib/python3.12/site-packages/WMCore/WMSpec/WMWorkloadTools.py", line 382, in checkDBSURL
    return DBS3Reader(url).checkDBSServer()
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

  File "/usr/local/lib/python3.12/site-packages/WMCore/Services/DBS/DBS3Reader.py", line 144, in checkDBSServer
    raise DBSReaderError(msg) from None

&lt;@---------- WMException End ----------@&gt;</p>
        <pre id="traceback"></pre>
    <div id="powered_by">
      <span>
        Powered by <a href="http://www.cherrypy.dev">CherryPy 18.10.0</a>
      </span>
    </div>
    </body>
</html>

Exiting!

It is discouraging that some internal exceptions are masked with an HTTP 400 response code when delivering a response to a client when it is not its issue. Please could you check this configuration so that appropriate response codes are returned in case of issues.

Nov 06 '25 12:11 ggonzr