[Bug][framework] Pipeline and task stuck for 4 days after the database connection lost

[klesh]

Search before asking

• [X] I had searched in the issues and found no similar issues.

What happened

What do you expect to happen

Pipeline, task and consecutive tasks should fail when the database is unavailable.

How to reproduce

Maybe take down the database when tasks are running?

Anything else

No response

Version

all

Are you willing to submit PR?

• [ ] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct

[klesh]

How I reproduce

1. brought up mysql backend and config-ui
2. kicked off a pipeline to collect data
3. shutdown the mysql service

What I found

1. backend exited with the following error as expected
2. config-ui should go into api offline page, but it didn't

[github-actions[bot]]

This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.

[github-actions[bot]]

This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.

[github-actions[bot]]

This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.

[github-actions[bot]]

This issue has been automatically marked as stale because it has been inactive for 60 days. It will be closed in next 7 days if no further activity occurs.

[github-actions[bot]]

This issue has been closed because it has been inactive for a long time. You can reopen it if you encounter the similar problem in the future.