Workflows in the Pending state that are waiting for the mutex are not showing in the UI

[omarkalloush]

Pre-requisites

• [X] I have double-checked my configuration
• [X] I can confirm the issues exists when I tested with :latest
• [ ] I'd like to contribute the fix myself (see contributing guide)

What happened/what you expected to happen?

What happened?

I deployed 2 workflows that has the same mutex the 2nd one wasn't visible in the UI till the 1st one finished

What is expected to happen?

The 2nd one used to be shown in the UI with the yellow mark saying it's pending and waiting for the mutex

Version

v3.4.1

Paste a small workflow that reproduces the issue. We must be able to run the workflow; don't enter a workflows that uses private images.

# Run this twice and notice the 2nd workflow behavior
apiVersion: argoproj.io/v1alpha1
kind: Workflow
metadata:
  generateName: synchronization-wf-level-
spec:
  entrypoint: whalesay
  synchronization:
    mutex:
      name:  test
  templates:
    - name: whalesay
      container:
        image: docker/whalesay:latest
        command: [cowsay]
        args: ["hello world"]

Logs from the workflow controller

kubectl logs -n argo deploy/workflow-controller | grep ${workflow}

Logs from in your workflow's wait container

kubectl logs -n argo -c wait -l workflows.argoproj.io/workflow=${workflow},workflow.argoproj.io/phase!=Succeeded

[sarabala1979]

@OmarKalloush can you provide the version which was working this?

[omarkalloush]

I have another environment with v3.3.9 it's working there

[omarkalloush]

@sarabala1979 Any updates?

[isubasinghe]

@OmarKalloush thanks for creating this issue, this due to the filtering not being done correctly. I am creating a PR for this now.