[BUG] Merging step, multiple errors in several batches

[radaniba]

I am using DH 10 and HC 5.4.3

I am running through some errors in the merging step and I am looking to understand more what they mean in order to find a resolution for them, as they seem to be related to different reasons

Out of 6 batches, 1 succeeded and 5 failed. The error messages are listed below.
Error 1
Message:  com.marklogic.client.FailedRequestException: Local message: failed to POST at /data-hub/5/data-services/stepRunner/processBatch.sjs: Internal Server Error. Server Message: JS-JAVASCRIPT: Error running JavaScript request: null . See the MarkLogic server error log for further detail.

Error 2
Message:  com.marklogic.client.FailedRequestException: Local message: failed to POST at /data-hub/5/data-services/stepRunner/processBatch.sjs: Internal Server Error. Server Message: PS-INVALIDNAMESPACES: (err:FOER0000) let record = ps.provenanceRecord(recordDetails.id, options); -- Invalid namespaces options in the provenance record . See the MarkLogic server error log for further detail.

Error 3
Message:  com.marklogic.client.FailedRequestException: Local message: failed to POST at /data-hub/5/data-services/stepRunner/processBatch.sjs: Internal Server Error. Server Message: SVC-EXTIME: Time limit exceeded

Error 4
Message: Time limit exceeded

URI:
Details:  SVC-EXTIME: xdmp.invoke("/data-hub/5/impl/hub-utils/invoke-queue-write.sjs", {...XDMP-EXTIME: Time limit exceeded..., {...XDMP-EXTIME: Time limit exceeded...) -- Time limit exceeded
in /data-hub/5/impl/hub-utils.sjs, at 48:24, in writeDocuments() [javascript]
in /data-hub/5/impl/flow.sjs, at 295:53, in runFlow() [javascript]
in /data-hub/5/data-services/stepRunner/processBatch.sjs, at 41:13 [javascript]
in /data-hub/5/data-services/stepRunner/processBatch.sjs [javascript]

Error 5
Message: Time limit exceeded

URI:
Details:  SVC-EXTIME: xdmp.documentGetCollections("/com.marklogic.smart-mastering/merged/6252ff2e7ab5156704aa0e0059...") -- Time limit exceeded
in /data-hub/5/impl/hub-utils.sjs, at 36:35 [javascript]
in /data-hub/5/impl/flow.sjs, at 295:53, in runFlow() [javascript]
in /data-hub/5/data-services/stepRunner/processBatch.sjs, at 41:13 [javascript]
in /data-hub/5/impl/hub-utils.sjs, at 48:24,
...

Most of them are related to time limit, my queries are optimized to the best I can with the given data.

[akshaysonvane]

Hi @radaniba, Would it be possible for you to share a bare minimum project that reproduces the issue?

[radaniba]

Hard for me to share this project in particular, most of the time limit issues disappeared with some edits on the time limits on the admin size I increased the time, but I will run again to see i other issues are coming from there as a consequence of some failing jobs

Rad