runner icon indicating copy to clipboard operation
runner copied to clipboard

Github Action workflows Hang

Open chenele opened this issue 1 year ago • 43 comments

Seems like there is an issue with Github Action Runners. all our different actions looks 'wierd'. The job output seems collapsed into a single Text output and seems ilke the job are never ends.

just created a simple dummy action to test it and it got reproduce.

name: Tester

on:
  push:

  
jobs:
  test:    
    runs-on: ubuntu-latest   
    
    steps:
      - uses: actions/checkout@v3
        with:
          fetch-depth: 0

      - name: echo
        run: |
          echo Bla  

Output is endless while at the end seems like job cannot complete the cleanup process.

Post job cleanup.
/usr/bin/git version
git version 2.47.0
Temporarily overriding HOME='/home/runner/work/_temp/ab3e00c9-67e9-4e9a-83c1-740a432d20c6' before making global git config changes
Adding repository directory to the temporary git global config as a safe directory
/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :"
/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
http.https://github.com/.extraheader
/usr/bin/git config --local --unset-all http.https://github.com/.extraheader
/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :"
Cleaning up orphan processes

Anyone else encountering such issues? havent seen anything yet on Github-Status indicating the issue

chenele avatar Oct 30 '24 07:10 chenele

same issue here, tried renaming the workflow, canceling the workflow doesn't work either, seems github never recognizes the output properly and considers the job "queued" forever even though the text in logs shows it as complete and successful

iairu avatar Oct 30 '24 07:10 iairu

same issue here

junha6316 avatar Oct 30 '24 07:10 junha6316

Facing the same issue with ubuntu-24.04 as runner os

melon-ruet avatar Oct 30 '24 07:10 melon-ruet

Facing same issue even though the runners are hosted private. Either it is queues to pick runner or getting stuck at Cleaning up orphan processes.

Mohammed-Keafeel avatar Oct 30 '24 07:10 Mohammed-Keafeel

same issue here, also showing last successful build is still running. Screenshot 2024-10-30 125232

Kavindu-Jayasinghe avatar Oct 30 '24 07:10 Kavindu-Jayasinghe

same issue here, tried renaming the workflow, canceling the workflow doesn't work either, seems github never recognizes the output properly and considers the job "queued" forever even though the text in logs shows it as complete and successful

renaming the job doesn't work either, left image is how it looks, right image is how it should look:

image image

here is my setup, still broken, haven't tried different OS from ubuntu-latest:

on:
  push:
    branches:
      - "*"

jobs:
  deploy_job:
    runs-on: ubuntu-latest
    name: build-deploy
    steps:
    ...

iairu avatar Oct 30 '24 07:10 iairu

same issue here :(

newdeal123 avatar Oct 30 '24 07:10 newdeal123

Tested it both from Organization account and private account, same result. also, seems like both jobs that worked yesterday and the ones that are failing today are using the SAME Ubuntu image version and OS.

Image: ubuntu-22.04
Version: 20241015.1.0
Image Provisioner 2.0.384.1

so it doesnt seems to be related to any update on the runner version Jobs are able to execute the flow, its just that they are failing to cleanup the process.

also, cancle does not work.

chenele avatar Oct 30 '24 07:10 chenele

My Deploymemt Is working fine and its done i can verify it on my server but still action showing queued.

AkshayDhadwal26 avatar Oct 30 '24 07:10 AkshayDhadwal26

same issue here :(

tracle-tw-joe avatar Oct 30 '24 07:10 tracle-tw-joe

Same

jocelyn-sm avatar Oct 30 '24 07:10 jocelyn-sm

Same

zzunny97 avatar Oct 30 '24 07:10 zzunny97

Facing the same issue. Getting status 500'd on force cancellation image

neilscallywag avatar Oct 30 '24 07:10 neilscallywag

same here, stuck on Cleaning up orphan processes - even for self-hosted runners.

niranx avatar Oct 30 '24 07:10 niranx

same

ramadhansyah avatar Oct 30 '24 07:10 ramadhansyah

Same

dongthg7 avatar Oct 30 '24 07:10 dongthg7

Same

beuself avatar Oct 30 '24 07:10 beuself

+1

wouter-leistra avatar Oct 30 '24 07:10 wouter-leistra

Same

jeypc avatar Oct 30 '24 07:10 jeypc

Also here

KevinArnaudLille avatar Oct 30 '24 07:10 KevinArnaudLille

tried different runs-on:

  • ubuntu-latest stuck
  • ubuntu-22.04 stuck
  • ubuntu-20.04 stuck

i'm out of options, seems the issue is platform independent, workflow independent, job name independent, branch and repository independent

iairu avatar Oct 30 '24 07:10 iairu

same.

yeongsheng-tan avatar Oct 30 '24 07:10 yeongsheng-tan

Same issue. Self Hosted K8S Runner.

I see that the pods start and work, but the feedback in the actions (web ui) is missing. It looks like all runners are stuck

procinger avatar Oct 30 '24 07:10 procinger

canceling the workflow actually does cancel it in logs if its still in progress however it doesn't affect the UI still showing as "queued"; canceling after Post job cleanup. has no effect on logs.

iairu avatar Oct 30 '24 07:10 iairu

Getting the same issue as well image image

young-min-choo avatar Oct 30 '24 07:10 young-min-choo

getting same isssue here. stuck after cleaning up orphan processes

Klassikcat avatar Oct 30 '24 07:10 Klassikcat

also same to us

https://github.com/Prompt-oven/prompt-oven/actions/runs/11588704913/job/32262874626?pr=20

yuseok-kim-edushare avatar Oct 30 '24 07:10 yuseok-kim-edushare

for anyone waiting:

  • it seems to be a UI issue, not a problem of actually getting the workflow to finish internally, simply ignore the UI "queued" state for now and read the logs
  • if you know how yours logs should end and your logs end without errors you can consider the run a success and proceed with your day

iairu avatar Oct 30 '24 07:10 iairu

An incident has been filed: https://www.githubstatus.com/incidents/9yk1fbk0qjjc

ayussh-verma avatar Oct 30 '24 07:10 ayussh-verma

Same issue, stuck after cleaning up orphan processes

FonsBiemans avatar Oct 30 '24 07:10 FonsBiemans