nx icon indicating copy to clipboard operation
nx copied to clipboard

Nx Agents command sometimes doesn't propagate error in tasks

Open timofei-iatsenko opened this issue 1 year ago • 2 comments

Current Behavior

We noticed this few times since implemented DTE, the main task hangs for hours. I checked the logs of each agent and that what i've found:

image

The log shows that task failed, but runner finished with non-zero code and didn't propogate this error to the cloud and main task. On the moment i've done this screenshot this run in NX was in pending status, however all tasks in the agents was executed.

Expected Behavior

It should fail in every case when error is happend.

GitHub Repo

No response

Steps to Reproduce

Unfortunately, it is hard to find steps to reproduce, since it happens sometimes on CI

Nx Report

Node   : 20.9.0
   OS     : darwin-arm64
   yarn   : 3.4.1
   
   nx (global)        : 17.2.7
   nx                 : 16.10.0
   @nx/js             : 16.10.0
   @nx/jest           : 16.10.0
   @nx/linter         : 16.10.0
   @nx/workspace      : 16.10.0
   @nx/angular        : 16.10.0
   @nx/cypress        : 16.10.0
   @nx/devkit         : 16.10.0
   @nx/esbuild        : 16.10.0
   @nx/eslint-plugin  : 16.10.0
   @nx/node           : 16.10.0
   @nrwl/tao          : 16.10.0
   @nx/webpack        : 16.10.0
   nx-cloud           : 16.5.2
   typescript         : 5.1.6
   ---------------------------------------
   Community plugins:
   @nebular/theme               : 11.0.1
   @simondotm/nx-firebase       : 2.1.2
   ng2-charts                   : 4.1.1
   ngx-daterangepicker-material : 6.0.4

Failure Logs

No response

Package Manager Version

No response

Operating System

  • [ ] macOS
  • [X] Linux
  • [ ] Windows
  • [ ] Other (Please specify)

Additional Information

No response

timofei-iatsenko avatar Jan 19 '24 15:01 timofei-iatsenko

could you send an email please to [email protected] and include your CI config (main + agents config) + a link to one of your CI executions on nx.app where the main job hanged?

rarmatei avatar Jan 30 '24 11:01 rarmatei

We also just experienced this with jest getting OOM killed and then the nx task just hangs

kdawgwilk avatar Jan 31 '24 19:01 kdawgwilk

Same issue here. Reported it to the cloud-support as per @rarmatei suggestion

faileon avatar Feb 08 '24 14:02 faileon

I am closing this issue since it's related to the Nx Cloud SAAS, not the Nx open-source solution.

If you are experiencing the same issue please follow @rarmatei's suggestion:

https://github.com/nrwl/nx/issues/21235#issuecomment-1916668129

meeroslav avatar May 27 '24 09:05 meeroslav