actions-runner-controller icon indicating copy to clipboard operation
actions-runner-controller copied to clipboard
verified publisher icon actions

GET https://broker.actions.githubusercontent.com/scalesets/message giving up after 1 attempt(s): context canceled

Open rgollapallli opened this issue 5 months ago • 8 comments

Checks

  • [x] I've already read https://docs.github.com/en/actions/hosting-your-own-runners/managing-self-hosted-runners-with-actions-runner-controller/troubleshooting-actions-runner-controller-errors and I'm sure my issue is not covered in the troubleshooting guide.
  • [x] I am using charts that are officially provided

Controller Version

0.12.0

Deployment Method

ArgoCD

Checks

  • [x] This isn't a question or user support case (For Q&A and community support, go to Discussions).
  • [x] I've read the Changelog before submitting this issue and I'm sure it's not due to any recently-introduced backward-incompatible changes

To Reproduce

Read Describe the bug section

Describe the bug

Iam Running the Actions-runner-controller version: 0.12.0 on EKS 1.31 cluster.

While installing the gha-runner-scale-set using below ArgoCD Application, iam facing the below error.

Logs from gha-runner-scale-set-listener pod:

2025-06-27T14:20:10Z INFO listener-app app initialized 2025-06-27T14:20:10Z INFO listener-app Starting listener 2025-06-27T14:20:10Z INFO listener-app refreshing token {"githubConfigUrl": "https://github.com/belletiredistributors"} 2025-06-27T14:20:10Z INFO listener-app getting runner registration token {"registrationTokenURL": "https://api.github.com/orgs/belletiredistributors/actions/runners/registration-token"} 2025-06-27T14:20:10Z INFO listener-app getting Actions tenant URL and JWT {"registrationURL": "https://api.github.com/actions/runner-registration"} 2025-06-27T14:20:11Z INFO listener-app.listener Current runner scale set statistics. {"statistics": "{"totalAvailableJobs":0,"totalAcquiredJobs":0,"totalAssignedJobs":0,"totalRunningJobs":0,"totalRegisteredRunners":0,"totalBusyRunners":0,"totalIdleRunners":0}"} 2025-06-27T14:20:11Z INFO listener-app.worker.kubernetesworker Calculated target runner count {"assigned job": 0, "decision": 0, "min": 0, "max": 15, "currentRunnerCount": 0, "jobsCompleted": 0} 2025-06-27T14:20:11Z INFO listener-app.worker.kubernetesworker Compare {"original": "{"metadata":{"creationTimestamp":null},"spec":{"replicas":-1,"patchID":-1,"ephemeralRunnerSpec":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}}},"status":{"currentReplicas":0,"pendingEphemeralRunners":0,"runningEphemeralRunners":0,"failedEphemeralRunners":0}}", "patch": "{"metadata":{"creationTimestamp":null},"spec":{"patchID":0,"ephemeralRunnerSpec":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}}},"status":{"currentReplicas":0,"pendingEphemeralRunners":0,"runningEphemeralRunners":0,"failedEphemeralRunners":0}}"} 2025-06-27T14:20:11Z INFO listener-app.worker.kubernetesworker Preparing EphemeralRunnerSet update {"json": "{"spec":{"patchID":0,"replicas":null}}"} 2025-06-27T14:20:11Z INFO listener-app.worker.kubernetesworker Ephemeral runner set scaled. {"namespace": "arc-runners", "name": "gha-runner-scale-set-global-897p8", "replicas": 0} 2025-06-27T14:20:11Z INFO listener-app.listener Getting next message {"lastMessageID": 0} 2025-06-27T14:20:12Z ERROR listener-app Retryable client error {"error": "Get "https://broker.actions.githubusercontent.com/scalesets/message": context canceled", "method": "GET", "url": "https://broker.actions.githubusercontent.com/scalesets/message", "error": "request failed"} github.com/actions/actions-runner-controller/github/actions.(*clientLogger).Error github.com/actions/actions-runner-controller/github/actions/client.go:78 github.com/hashicorp/go-retryablehttp.(*Client).Do github.com/hashicorp/[email protected]/client.go:718 github.com/hashicorp/go-retryablehttp.(*RoundTripper).RoundTrip github.com/hashicorp/[email protected]/roundtripper.go:47 net/http.send net/http/client.go:259 net/http.(*Client).send net/http/client.go:180 net/http.(*Client).do net/http/client.go:728 net/http.(*Client).Do net/http/client.go:587 github.com/actions/actions-runner-controller/github/actions.(*Client).Do github.com/actions/actions-runner-controller/github/actions/client.go:275 github.com/actions/actions-runner-controller/github/actions.(*Client).GetMessage github.com/actions/actions-runner-controller/github/actions/client.go:578 github.com/actions/actions-runner-controller/cmd/ghalistener/listener.(*Listener).getMessage github.com/actions/actions-runner-controller/cmd/ghalistener/listener/listener.go:272 github.com/actions/actions-runner-controller/cmd/ghalistener/listener.(*Listener).Listen github.com/actions/actions-runner-controller/cmd/ghalistener/listener/listener.go:163 github.com/actions/actions-runner-controller/cmd/ghalistener/app.(*App).Run.func1 github.com/actions/actions-runner-controller/cmd/ghalistener/app/app.go:130 golang.org/x/sync/errgroup.(*Group).Go.func1 golang.org/x/[email protected]/errgroup/errgroup.go:78 2025-06-27T14:20:12Z INFO listener-app.listener Deleting message session 2025/06/27 14:20:12 Application returned an error: failed to get message: failed to get next message: failed to issue the request: client request failed: Get "https://broker.actions.githubusercontent.com/scalesets/message": GET https://broker.actions.githubusercontent.com/scalesets/message giving up after 1 attempt(s): context canceled

Describe the expected behavior

Runner-scale-set-listener need to run.

Additional Context

gha-runner-scale-set-controller ArgoCD application:
=================================
apiVersion: argoproj.io/v1alpha1
kind: Application
metadata:
  name: gha-runner-scale-set-controller
  namespace: argocd
  annotations:
    argocd.argoproj.io/sync-wave: "1"
  finalizers:
    - resources-finalizer.argocd.argoproj.io
spec:
  project: default
  source:
    repoURL: https://github.com/XXX/XXXX
    path: packages/cicd/gha-runner-scale-set-controller
    targetRevision: dev
    helm:
      parameters:
        - name: nameOverride
          value: "gha-runner-scale-set-controller"
        - name: fullnameOverride
          value: "gha-runner-scale-set-controller"
        - name: replicaCount
          value: "1"
        - name: image.repository
          value: "ghcr.io/actions/gha-runner-scale-set-controller"
        - name: image.tag
          value: 0.12.0
        - name: image.pullPolicy
          value: "Always"
        - name: serviceAccount.create
          value: "true"
        - name: serviceAccount.name
          value: "gha-runner-scale-set-controller"
        - name: serviceAccount.annotations.eks\.amazonaws\.com/role-arn
          value: arn:aws:iam::XXXXXX:role/actions-runner-controller
        - name: flags.updateStrategy
          value: "immediate"
        - name: flags.runnerMaxConcurrentReconciles
          value: "2"
        - name: flags.logLevel
          value: "debug"
  destination:
    server: https://kubernetes.default.svc
    namespace: arc-systems
  syncPolicy:
    automated:
      prune: true
      selfHeal: true
      allowEmpty: false
    syncOptions:
      - Validate=false
      - CreateNamespace=false
      - ServerSideApply=true
    retry:
      limit: 5
      backoff:
        duration: 5s
        factor: 2
        maxDuration: 3m
  ignoreDifferences:
    - group: apps
      kind: Deployment
      name: gha-runner-scale-set-controller
      namespace: arc-systems
      jsonPointers:
        - /spec/template/spec/containers/0/resources

gha-runner-scale-set ArgoCD application:
==========================
apiVersion: argoproj.io/v1alpha1
kind: Application
metadata:
  name: gha-runner-scale-set-global
  namespace: argocd
  annotations:
    argocd.argoproj.io/sync-wave: "2"
  finalizers:
    - resources-finalizer.argocd.argoproj.io
spec:
  project: default
  source:
    repoURL: https://github.com/XXXXX/XXXX
    path: packages/cicd/gha-runner-scale-set
    targetRevision: dev
    helm:
      parameters:
        - name: githubConfigUrl
          value: "https://github.com/<Orgname>"
        - name: githubConfigSecret.github_token
          value: "XXXXXXXXXXXX"
        - name: minRunners
          value: "0"
        - name: maxRunners
          value: "15"
        - name: runnerGroup
          value: "bt-github-actions-runner-scale-set"
        - name: runnerScaleSetName
          value: "gha-runner-scale-set-global"
        - name: containerMode.type
          value: "kubernetes"
        - name: containerMode.kubernetesModeWorkVolumeClaim.storageClassName
          value: "sc-gha-runner-scale-set-global"
        - name: containerMode.kubernetesModeWorkVolumeClaim.accessModes[0]
          value: "ReadWriteOnce"
        - name: containerMode.kubernetesModeWorkVolumeClaim.resources.requests.storage
          value: "1Gi"
        - name: template.spec.containers[0].name
          value: "runner"
        - name: template.spec.containers[0].image
          value: ghcr.io/actions/actions-runner:2.325.0
        - name: template.spec.containers[0].command[0]
          value: "/home/runner/run.sh"
        - name: template.spec.containers[0].env[0].name
          value: "ACTIONS_RUNNER_CONTAINER_HOOKS"
        - name: template.spec.containers[0].env[0].value
          value: "/home/runner/k8s/index.js"
        - name: template.spec.containers[0].env[1].name
          value: "ACTIONS_RUNNER_POD_NAME"
        - name: template.spec.containers[0].env[1].valueFrom.fieldRef.fieldPath
          value: "metadata.name"
        - name: template.spec.containers[0].env[2].name
          value: "ACTIONS_RUNNER_REQUIRE_JOB_CONTAINER"
        - name: template.spec.containers[0].env[2].value
          value: \'false\'
        - name: controllerServiceAccount.name
          value: "gha-runner-scale-set-controller"
        - name: controllerServiceAccount.namespace
          value: arc-systems
        - name: namespaceOverride
          value: "arc-runners"
  destination:
    server: https://kubernetes.default.svc
    namespace: arc-runners
  syncPolicy:
    automated:
      prune: true
      selfHeal: true
      allowEmpty: false
    syncOptions:
      - Validate=false
      - CreateNamespace=false
      - ServerSideApply=true
    retry:
      limit: 5
      backoff:
        duration: 5s
        factor: 2
        maxDuration: 3m

AutoscalingListener manifest:
==================
apiVersion: actions.github.com/v1alpha1
kind: AutoscalingListener
metadata:
  annotations:
    actions.github.com/runner-spec-hash: 766f58dbf4
    actions.github.com/values-hash: aad239e3b205b16ee21a4744f566393d08903ff9935afc51d110022a7329e5f
  creationTimestamp: '2025-06-27T14:18:18Z'
  finalizers:
    - autoscalinglistener.actions.github.com/finalizer
  generation: 1
  labels:
    actions.github.com/organization: belletiredistributors
    actions.github.com/scale-set-name: gha-runner-scale-set-global
    actions.github.com/scale-set-namespace: arc-runners
    app.kubernetes.io/component: runner-scale-set-listener
    app.kubernetes.io/instance: gha-runner-scale-set-global
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: gha-runner-scale-set-global
    app.kubernetes.io/part-of: gha-runner-scale-set
    app.kubernetes.io/version: 0.12.0
    helm.sh/chart: gha-rs-0.12.0
  name: gha-runner-scale-set-global-754b578d-listener
  namespace: arc-systems
  resourceVersion: '163756078'
  uid: f824a931-3dc3-492d-9974-b96f3279a6ee
spec:
  autoscalingRunnerSetName: gha-runner-scale-set-global
  autoscalingRunnerSetNamespace: arc-runners
  ephemeralRunnerSetName: gha-runner-scale-set-global-897p8
  githubConfigSecret: gha-runner-scale-set-global-gha-rs-github-secret
  githubConfigUrl: 'https://github.com/belletiredistributors'
  image: 'ghcr.io/actions/gha-runner-scale-set-controller:0.12.0'
  maxRunners: 15
  runnerScaleSetId: 10


gha-runner-scale-set-listener pod manifest:
===========================
apiVersion: v1
kind: Pod
metadata:
  creationTimestamp: '2025-06-27T17:26:26Z'
  labels:
    actions.github.com/organization: XXXXXXXXXXXX
    actions.github.com/scale-set-name: gha-runner-scale-set-global
    actions.github.com/scale-set-namespace: arc-runners
    app.kubernetes.io/component: runner-scale-set-listener
    app.kubernetes.io/instance: gha-runner-scale-set-global
    app.kubernetes.io/managed-by: Helm
    app.kubernetes.io/name: gha-runner-scale-set-global
    app.kubernetes.io/part-of: gha-runner-scale-set
    app.kubernetes.io/version: 0.12.0
    helm.sh/chart: gha-rs-0.12.0
  name: gha-runner-scale-set-global-754b578d-listener
  namespace: arc-systems
  ownerReferences:
    - apiVersion: actions.github.com/v1alpha1
      blockOwnerDeletion: true
      controller: true
      kind: AutoscalingListener
      name: gha-runner-scale-set-global-754b578d-listener
      uid: 81cd7481-af32-4cef-974f-f2dc8b1d0ad6
  resourceVersion: '163976436'
  uid: 1f4f05e3-d5ea-4149-8276-bcf01e29f925
spec:
  containers:
    - command:
        - /ghalistener
      env:
        - name: LISTENER_CONFIG_PATH
          value: /etc/gha-listener/config.json
      image: 'ghcr.io/actions/gha-runner-scale-set-controller:0.12.0'
      imagePullPolicy: IfNotPresent
      name: listener
      resources: {}
      terminationMessagePath: /dev/termination-log
      terminationMessagePolicy: File
      volumeMounts:
        - mountPath: /etc/gha-listener
          name: listener-config
          readOnly: true
        - mountPath: /var/run/secrets/kubernetes.io/serviceaccount
          name: kube-api-access-k2bvt
          readOnly: true
  dnsPolicy: ClusterFirst
  enableServiceLinks: true
  nodeName: ip-10-0-33-11.us-east-2.compute.internal
  preemptionPolicy: PreemptLowerPriority
  priority: 0
  restartPolicy: Never
  schedulerName: default-scheduler
  securityContext: {}
  serviceAccount: gha-runner-scale-set-global-754b578d-listener
  serviceAccountName: gha-runner-scale-set-global-754b578d-listener
  terminationGracePeriodSeconds: 60
  tolerations:
    - effect: NoExecute
      key: node.kubernetes.io/not-ready
      operator: Exists
      tolerationSeconds: 300
    - effect: NoExecute
      key: node.kubernetes.io/unreachable
      operator: Exists
      tolerationSeconds: 300
  volumes:
    - name: listener-config
      secret:
        defaultMode: 420
        secretName: gha-runner-scale-set-global-754b578d-listener-config
    - name: kube-api-access-k2bvt
      projected:
        defaultMode: 420
        sources:
          - serviceAccountToken:
              expirationSeconds: 3607
              path: token
          - configMap:
              items:
                - key: ca.crt
                  path: ca.crt
              name: kube-root-ca.crt
          - downwardAPI:
              items:
                - fieldRef:
                    apiVersion: v1
                    fieldPath: metadata.namespace
                  path: namespace

Controller Logs

2025-06-27T17:01:40Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:40Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Listener pod is deleted	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Listener role binding is deleted	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Listener role is deleted	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Cleaning up the listener service account	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Listener service account is deleted	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Successfully removed finalizer after cleanup	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingRunnerSet	Find existing ephemeral runner set	{"version": "0.12.0", "autoscalingrunnerset": {"name":"gha-runner-scale-set-global","namespace":"arc-runners"}, "name": "gha-runner-scale-set-global-897p8", "specHash": "59ccb6dc69"}
2025-06-27T17:01:41Z	INFO	AutoscalingRunnerSet	Find existing ephemeral runner set	{"version": "0.12.0", "autoscalingrunnerset": {"name":"gha-runner-scale-set-global","namespace":"arc-runners"}, "name": "gha-runner-scale-set-global-897p8", "specHash": "59ccb6dc69"}
2025-06-27T17:01:41Z	INFO	AutoscalingRunnerSet	AutoscalingListener does not exist.	{"version": "0.12.0", "autoscalingrunnerset": {"name":"gha-runner-scale-set-global","namespace":"arc-runners"}}
2025-06-27T17:01:41Z	INFO	AutoscalingRunnerSet	Creating a new AutoscalingListener for the runner set	{"version": "0.12.0", "autoscalingrunnerset": {"name":"gha-runner-scale-set-global","namespace":"arc-runners"}, "ephemeralRunnerSetName": "gha-runner-scale-set-global-897p8"}
2025-06-27T17:01:41Z	INFO	AutoscalingRunnerSet	Creating a new AutoscalingListener resource	{"version": "0.12.0", "autoscalingrunnerset": {"name":"gha-runner-scale-set-global","namespace":"arc-runners"}, "name": "gha-runner-scale-set-global-754b578d-listener", "namespace": "arc-systems"}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Adding finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingRunnerSet	Created a new AutoscalingListener resource	{"version": "0.12.0", "autoscalingrunnerset": {"name":"gha-runner-scale-set-global","namespace":"arc-runners"}, "name": "gha-runner-scale-set-global-754b578d-listener", "namespace": "arc-systems"}
2025-06-27T17:01:41Z	INFO	AutoscalingRunnerSet	Find existing ephemeral runner set	{"version": "0.12.0", "autoscalingrunnerset": {"name":"gha-runner-scale-set-global","namespace":"arc-runners"}, "name": "gha-runner-scale-set-global-897p8", "specHash": "59ccb6dc69"}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Successfully added finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingRunnerSet	Find existing ephemeral runner set	{"version": "0.12.0", "autoscalingrunnerset": {"name":"gha-runner-scale-set-global","namespace":"arc-runners"}, "name": "gha-runner-scale-set-global-897p8", "specHash": "59ccb6dc69"}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Creating a service account for the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Creating listener service accounts	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}, "namespace": "arc-systems", "name": "gha-runner-scale-set-global-754b578d-listener"}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Created listener service accounts	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}, "namespace": "arc-systems", "name": "gha-runner-scale-set-global-754b578d-listener"}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Creating a role for the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Creating listener role	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}, "namespace": "arc-runners", "name": "gha-runner-scale-set-global-754b578d-listener", "rules": [{"verbs":["patch"],"apiGroups":["actions.github.com"],"resources":["ephemeralrunnersets"],"resourceNames":["gha-runner-scale-set-global-897p8"]},{"verbs":["patch"],"apiGroups":["actions.github.com"],"resources":["ephemeralrunners","ephemeralrunners/status"]}]}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Created listener role	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}, "namespace": "arc-runners", "name": "gha-runner-scale-set-global-754b578d-listener", "rules": [{"verbs":["patch"],"apiGroups":["actions.github.com"],"resources":["ephemeralrunnersets"],"resourceNames":["gha-runner-scale-set-global-897p8"]},{"verbs":["patch"],"apiGroups":["actions.github.com"],"resources":["ephemeralrunners","ephemeralrunners/status"]}]}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Creating a role binding for the service account and role	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Creating listener role binding	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}, "namespace": "arc-runners", "name": "gha-runner-scale-set-global-754b578d-listener", "role": "gha-runner-scale-set-global-754b578d-listener", "serviceAccountNamespace": "arc-systems", "serviceAccount": "gha-runner-scale-set-global-754b578d-listener"}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Created listener role binding	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}, "namespace": "arc-runners", "name": "gha-runner-scale-set-global-754b578d-listener", "role": "gha-runner-scale-set-global-754b578d-listener", "serviceAccountNamespace": "arc-systems", "serviceAccount": "gha-runner-scale-set-global-754b578d-listener"}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Creating a listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Creating listener config secret	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Creating a listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Creating listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}, "namespace": "arc-systems", "name": "gha-runner-scale-set-global-754b578d-listener"}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Created listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}, "namespace": "arc-systems", "name": "gha-runner-scale-set-global-754b578d-listener"}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Listener pod is not ready	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}, "namespace": "arc-systems", "name": "gha-runner-scale-set-global-754b578d-listener"}
2025-06-27T17:01:41Z	INFO	AutoscalingListener	Listener pod is not ready	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}, "namespace": "arc-systems", "name": "gha-runner-scale-set-global-754b578d-listener"}
2025-06-27T17:01:45Z	INFO	AutoscalingRunnerSet	Find existing ephemeral runner set	{"version": "0.12.0", "autoscalingrunnerset": {"name":"gha-runner-scale-set-global","namespace":"arc-runners"}, "name": "gha-runner-scale-set-global-897p8", "specHash": "59ccb6dc69"}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Deleting the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:45Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Waiting for resources to be deleted before removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Deleting resources	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Cleaning up the listener pod	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Listener pod is deleted	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Listener role binding is deleted	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Listener role is deleted	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Cleaning up the listener service account	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Listener service account is deleted	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingListener	Removing finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}}
2025-06-27T17:01:46Z	INFO	AutoscalingRunnerSet	Find existing ephemeral runner set	{"version": "0.12.0", "autoscalingrunnerset": {"name":"gha-runner-scale-set-global","namespace":"arc-runners"}, "name": "gha-runner-scale-set-global-897p8", "specHash": "59ccb6dc69"}
2025-06-27T17:01:46Z	ERROR	AutoscalingListener	Failed to remove finalizer	{"version": "0.12.0", "autoscalinglistener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}, "error": "AutoscalingListener.actions.github.com \"gha-runner-scale-set-global-754b578d-listener\" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{\"foregroundDeletion\"}"}
github.com/actions/actions-runner-controller/controllers/actions%2egithub%2ecom.(*AutoscalingListenerReconciler).Reconcile
	github.com/actions/actions-runner-controller/controllers/actions.github.com/autoscalinglistener_controller.go:102
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Reconcile
	sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:119
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler
	sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:334
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem
	sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:294
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2
	sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:255
2025-06-27T17:01:46Z	ERROR	Reconciler error	{"controller": "autoscalinglistener", "controllerGroup": "actions.github.com", "controllerKind": "AutoscalingListener", "AutoscalingListener": {"name":"gha-runner-scale-set-global-754b578d-listener","namespace":"arc-systems"}, "namespace": "arc-systems", "name": "gha-runner-scale-set-global-754b578d-listener", "reconcileID": "c0131a66-7861-4d43-be98-f575fae95120", "error": "AutoscalingListener.actions.github.com \"gha-runner-scale-set-global-754b578d-listener\" is invalid: metadata.finalizers: Forbidden: no new finalizers can be added if the object is being deleted, found new finalizers []string{\"foregroundDeletion\"}"}
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).reconcileHandler
	sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:347
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).processNextWorkItem
	sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:294
sigs.k8s.io/controller-runtime/pkg/internal/controller.(*Controller[...]).Start.func2.2
	sigs.k8s.io/[email protected]/pkg/internal/controller/controller.go:255

Runner Pod Logs

25-06-27 17:32:41Z INFO HostContext] No proxy settings were found based on environmental variables (http_proxy/https_proxy/HTTP_PROXY/HTTPS_PROXY)
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known config file 'Credentials': '/home/runner/.credentials'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known config file 'Runner': '/home/runner/.runner'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Adding extra user agent 'actions-runner-controller/0.12.0' to all HTTP requests.
[RUNNER 2025-06-27 17:32:41Z INFO Listener] Runner is built for Linux (X64) - linux-x64.
[RUNNER 2025-06-27 17:32:41Z INFO Listener] RuntimeInformation: Ubuntu 22.04.5 LTS.
[RUNNER 2025-06-27 17:32:41Z INFO Listener] Version: 2.325.0
[RUNNER 2025-06-27 17:32:41Z INFO Listener] Commit: 71ed7cd46223bd5d61633445946813012b502d54
[RUNNER 2025-06-27 17:32:41Z INFO Listener] Culture:
[RUNNER 2025-06-27 17:32:41Z INFO Listener] UI Culture:
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO Listener] Validating directory permissions for: '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO CommandLineParser] Parse
[RUNNER 2025-06-27 17:32:41Z INFO CommandLineParser] Parsing 1 args
[RUNNER 2025-06-27 17:32:41Z INFO CommandLineParser] parsing argument
[RUNNER 2025-06-27 17:32:41Z INFO CommandLineParser] HasArgs: False
[RUNNER 2025-06-27 17:32:41Z INFO CommandLineParser] Adding Command: run
[RUNNER 2025-06-27 17:32:41Z INFO CommandSettings] Removing env var: 'ACTIONS_RUNNER_INPUT_JITCONFIG'
[RUNNER 2025-06-27 17:32:41Z INFO Listener] Arguments parsed
[RUNNER 2025-06-27 17:32:41Z INFO Runner] ExecuteCommand
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] currentAssemblyLocation: /home/runner/bin/Runner.Listener.dll
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] binPath: /home/runner/bin
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] RootFolder: /home/runner
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known config file 'Runner': '/home/runner/.runner'
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] ConfigFilePath: /home/runner/.runner
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known config file 'MigratedRunner': '/home/runner/.runner_migrated'
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] MigratedConfigFilePath: /home/runner/.runner_migrated
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known config file 'Credentials': '/home/runner/.credentials'
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] CredFilePath: /home/runner/.credentials
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known config file 'MigratedCredentials': '/home/runner/.credentials_migrated'
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] MigratedCredFilePath: /home/runner/.credentials_migrated
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known config file 'Service': '/home/runner/.service'
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] ServiceConfigFilePath: /home/runner/.service
[RUNNER 2025-06-27 17:32:41Z INFO CommandSettings] Flag 'help': 'False'
[RUNNER 2025-06-27 17:32:41Z INFO CommandSettings] Flag 'version': 'False'
[RUNNER 2025-06-27 17:32:41Z INFO CommandSettings] Flag 'commit': 'False'
[RUNNER 2025-06-27 17:32:41Z INFO CommandSettings] Flag 'check': 'False'
[RUNNER 2025-06-27 17:32:41Z INFO CommandSettings] Command 'configure': 'False'
[RUNNER 2025-06-27 17:32:41Z INFO CommandSettings] Command 'remove': 'False'
[RUNNER 2025-06-27 17:32:41Z INFO CommandSettings] Command 'warmup': 'False'
[RUNNER 2025-06-27 17:32:41Z INFO CommandSettings] Env arg 'jitconfig': '***'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO Runner] Saved 450 bytes to '/home/runner/.runner'.
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO Runner] Saved 225 bytes to '/home/runner/.credentials'.
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO Runner] Saved 1631 bytes to '/home/runner/.credentials_rsaparams'.
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] No proxy settings were found based on environmental variables (http_proxy/https_proxy/HTTP_PROXY/HTTPS_PROXY)
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known config file 'Credentials': '/home/runner/.credentials'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known config file 'Runner': '/home/runner/.runner'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Adding extra user agent 'actions-runner-controller/0.12.0' to all HTTP requests.
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationManager] LoadSettings
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] IsConfigured()
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] IsConfigured: True
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationManager] Is configured: True
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] Read setting file: 450 chars
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationManager] Settings Loaded
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] IsServiceConfigured()
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] IsServiceConfigured: False
[RUNNER 2025-06-27 17:32:41Z INFO CommandSettings] Command 'run': 'True'
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] IsConfigured()
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] IsConfigured: True
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationManager] Is configured: True
[RUNNER 2025-06-27 17:32:41Z INFO Runner] Could not parse the argument value '' for StartupType. Defaulting to Manual
[RUNNER 2025-06-27 17:32:41Z INFO Runner] Set runner startup type - Manual
[RUNNER 2025-06-27 17:32:41Z INFO CommandSettings] Flag 'once': 'False'
[RUNNER 2025-06-27 17:32:41Z INFO CommandSettings] Flag 'once': 'False'
[RUNNER 2025-06-27 17:32:41Z INFO Runner] RunAsync
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationManager] LoadMigratedSettings
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] IsMigratedConfigured()
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] IsMigratedConfigured: False
[RUNNER 2025-06-27 17:32:41Z INFO Runner] Failed to load migrated settings: No migrated configuration found.
[RUNNER 2025-06-27 17:32:41Z INFO Runner] Falling back to original .runner settings
[RUNNER 2025-06-27 17:32:41Z INFO Runner] Using BrokerMessageListener
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener] Using provided settings
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener] {
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener]   "AgentId": 6858,
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener]   "AgentName": "gha-runner-scale-set-global-897p8-runner-xwp5k",
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener]   "PoolId": 5,
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener]   "DisableUpdate": true,
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener]   "Ephemeral": true,
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener]   "ServerUrl": "https://pipelinesghubeus22.actions.githubusercontent.com/Yh82O19jYCyvFmFWrRRPiatXeOt9tNBeSuJvUjCovtigsYtjIJ/",
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener]   "WorkFolder": "_work",
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener]   "UseV2Flow": true,
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener]   "ServerUrlV2": "https://broker.actions.githubusercontent.com/"
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener] }
[RUNNER 2025-06-27 17:32:41Z INFO BrokerMessageListener] Loading Credentials
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] HasCredentials()
[RUNNER 2025-06-27 17:32:41Z INFO ConfigurationStore] stored True
[RUNNER 2025-06-27 17:32:41Z INFO CredentialManager] GetCredentialProvider
[RUNNER 2025-06-27 17:32:41Z INFO CredentialManager] Creating type OAuth
[RUNNER 2025-06-27 17:32:41Z INFO CredentialManager] Creating credential type: OAuth
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Bin': '/home/runner/bin'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known directory 'Root': '/home/runner'
[RUNNER 2025-06-27 17:32:41Z INFO HostContext] Well known config file 'RSACredentials': '/home/runner/.credentials_rsaparams'
[RUNNER 2025-06-27 17:32:41Z INFO RSAFileKeyManager] Loading RSA key parameters from file /home/runner/.credentials_rsaparams
[RUNNER 2025-06-27 17:32:42Z INFO BrokerMessageListener] Attempt to create session.
[RUNNER 2025-06-27 17:32:42Z INFO BrokerMessageListener] Connecting to the Broker Server...
[RUNNER 2025-06-27 17:32:42Z INFO ConfigurationStore] HasCredentials()
[RUNNER 2025-06-27 17:32:42Z INFO ConfigurationStore] stored True
[RUNNER 2025-06-27 17:32:42Z INFO CredentialManager] GetCredentialProvider
[RUNNER 2025-06-27 17:32:42Z INFO CredentialManager] Creating type OAuth
[RUNNER 2025-06-27 17:32:42Z INFO CredentialManager] Creating credential type: OAuth
[RUNNER 2025-06-27 17:32:42Z INFO RSAFileKeyManager] Loading RSA key parameters from file /home/runner/.credentials_rsaparams
[RUNNER 2025-06-27 17:32:42Z INFO BrokerMessageListener] VssConnection created
[RUNNER 2025-06-27 17:32:42Z INFO BrokerMessageListener] Connecting to the Runner server...
[RUNNER 2025-06-27 17:32:42Z INFO RunnerServer] EstablishVssConnection
[RUNNER 2025-06-27 17:32:42Z INFO RunnerServer] Establish connection with 100 seconds timeout.
[RUNNER 2025-06-27 17:32:42Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[RUNNER 2025-06-27 17:32:42Z INFO RunnerServer] EstablishVssConnection
[RUNNER 2025-06-27 17:32:42Z INFO RunnerServer] Establish connection with 60 seconds timeout.
[RUNNER 2025-06-27 17:32:42Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[RUNNER 2025-06-27 17:32:42Z INFO RunnerServer] EstablishVssConnection
[RUNNER 2025-06-27 17:32:42Z INFO RunnerServer] Establish connection with 60 seconds timeout.
[RUNNER 2025-06-27 17:32:42Z INFO GitHubActionsService] Starting operation Location.GetConnectionData
[RUNNER 2025-06-27 17:32:42Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[RUNNER 2025-06-27 17:32:42Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[RUNNER 2025-06-27 17:32:42Z INFO GitHubActionsService] Finished operation Location.GetConnectionData
[RUNNER 2025-06-27 17:32:43Z INFO BrokerMessageListener] VssConnection created
[RUNNER 2025-06-27 17:32:43Z INFO Terminal] WRITE LINE:
√ Connected to GitHub
[RUNNER 2025-06-27 17:32:43Z INFO Terminal] WRITE LINE:
[RUNNER 2025-06-27 17:32:43Z INFO RSAFileKeyManager] Loading RSA key parameters from file /home/runner/.credentials_rsaparams
[RUNNER 2025-06-27 17:32:43Z INFO RSAFileKeyManager] Loading RSA key parameters from file /home/runner/.credentials_rsaparams
[RUNNER 2025-06-27 17:32:44Z INFO GitHubActionsService] AAD Correlation ID for this token request: Unknown
[RUNNER 2025-06-27 17:32:44Z INFO BrokerMessageListener] Session created.
[RUNNER 2025-06-27 17:32:44Z INFO Terminal] WRITE LINE: Current runner version: '2.325.0'
Current runner version: '2.325.0'
[RUNNER 2025-06-27 17:32:44Z INFO Terminal] WRITE LINE: 2025-06-27 17:32:44Z: Listening for Jobs
2025-06-27 17:32:44Z: Listening for Jobs
[RUNNER 2025-06-27 17:32:44Z INFO JobDispatcher] Set runner/worker IPC timeout to 30 seconds.

rgollapallli avatar Jun 27 '25 17:06 rgollapallli

Hello! Thank you for filing an issue.

The maintainers will triage your issue shortly.

In the meantime, please take a look at the troubleshooting guide for bug reports.

If this is a feature request, please review our contribution guidelines.

github-actions[bot] avatar Jun 27 '25 17:06 github-actions[bot]

We are running into a similar problem as well.

danielamar101-pton avatar Jul 02 '25 14:07 danielamar101-pton

I'm having the same issue. Listener pods created by the AutoscalingRunnerSet enter a continuous 4-second creation/deletion loop, never stabilizing to handle jobs. I think this is what's happening:

  1. AutoscalingListener controller creates listener-config secret and listener pod simultaneously
  2. Pod fails to start because kubelet hasn't synced the secret to local cache yet
  3. Status update triggers hash mismatch in parent AutoscalingRunnerSet controller
  4. Controller incorrectly deletes listener thinking it's “out of date”
  5. Cycle repeats every 4 seconds

I see this in the controller logs:

2025-07-14T05:06:46Z INFO  AutoscalingRunnerSet Deleting resources      {"version":"0.12.1","autoscalingrunnerset":{"name":"uat-runners","namespace":"actions-runner-system"}}
2025-07-14T05:06:46Z INFO  AutoscalingRunnerSet Cleaning up the listener {"version":"0.12.1","autoscalingrunnerset":{"name":"uat-runners","namespace":"actions-runner-system"}}
2025-07-14T05:06:46Z INFO  AutoscalingRunnerSet Waiting for listener to be deleted {"version":"0.12.1","autoscalingrunnerset":{"name":"uat-runners","namespace":"actions-runner-system"}}
2025-07-14T05:06:46Z INFO  AutoscalingListener  Deleting resources      {"version":"0.12.1","autoscalinglistener":{"name":"uat-runners-884475f5-listener","namespace":"actions-runner-system"}}
2025-07-14T05:06:46Z INFO  AutoscalingListener  Cleaning up the listener pod {"version":"0.12.1","autoscalinglistener":{"name":"uat-runners-884475f5-listener","namespace":"actions-runner-system"}}
2025-07-14T05:06:46Z INFO  AutoscalingListener  Listener pod is deleted {"version":"0.12.1","autoscalinglistener":{"name":"uat-runners-884475f5-listener","namespace":"actions-runner-system"}}

FailedMount error

Warning  FailedMount … MountVolume.SetUp failed for volume "listener-config": failed to sync secret cache: timed out waiting for the condition

I attempted to create an init container with secret-wait logic (based on a comment in another issue) but the pod spec is rejected by kubelet before the containers can run.

I debugged the cluster extensively for network issues, and everything checks out.

I have not been able to find a workaround so far. It looks like the same issue as in these last few comments.

@nikola-jokic this is a brand-new deployment, not an upgrade—any direction would be appreciated!

collagenial avatar Jul 14 '25 07:07 collagenial

I'm encountering a similar issue with a comparable ArgoCD setup.

When I tested manually on my local machine by installing the Helm charts using my personal PAT, everything worked fine. However, it's unclear why it doesn't work with ArgoCD when using the GitHub App.

nsudhakar-devcloud avatar Aug 07 '25 09:08 nsudhakar-devcloud

@collagenial any work around you have done at present to move forward ??

nsudhakar-devcloud avatar Aug 07 '25 09:08 nsudhakar-devcloud

We're also hitting this same issue on a new deployment using ArgoCD and version 0.12.1.

ccp-void avatar Aug 20 '25 10:08 ccp-void

if you're using enterprise github, note (top of page here) that GitHub Apps are not supported...

https://docs.github.com/en/actions/tutorials/use-actions-runner-controller/authenticate-to-the-api

jingles avatar Sep 25 '25 20:09 jingles

Hey! can be related to https://github.com/actions/actions-runner-controller/issues/3533

Adding the following solved it for me when implementing with argoCD

  flags:
    excludeLabelPropagationPrefixes:
    - "argocd.argoproj.io/instance"

naldrey avatar Oct 09 '25 13:10 naldrey