dinky icon indicating copy to clipboard operation
dinky copied to clipboard

[Bug] [Module Name] Bug title Dinky often DOWN after up 4-10 hours with hs_error.log

Open Anton2025-11-06 opened this issue 1 month ago • 3 comments

Search before asking

  • [x] I had searched in the issues and found no similar issues.

What happened

dinky版本1.2.4 dinky启动后,隔4-10个小时,就挂了。 我们是用海豚调度器每隔10分钟,调度一次dinky里面的批任务。生产实践发现,海豚微批调度dinky,时间长了后,dinky会经常挂了,每次挂了,都有hs_error的log。

hs_error如下: Image

从grafana上面看,dinky内存没满过,cpu很空闲,gc压力很小。但有个线程数的指标,一直在持续增大,目前怀疑是不是dinky内部线程释放 存在 不释放的问题?

What you expected to happen

指导如何解决这个问题

How to reproduce

Anything else

No response

Version

dev

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

Anton2025-11-06 avatar Nov 26 '25 01:11 Anton2025-11-06

Grafana截图如下:

Image Image

Anton2025-11-06 avatar Nov 26 '25 01:11 Anton2025-11-06

Image

Anton2025-11-06 avatar Nov 26 '25 01:11 Anton2025-11-06

Image

1.2.4 /openapi/submittask 里面用了ThreadLocal, set后 没有用remove释放,和这个有关吗?

Anton2025-11-06 avatar Nov 26 '25 02:11 Anton2025-11-06

Hi. ThreadLocal doesn't increase the number of threads. What is the deployment method of your task, local or remote?

aiwenmo avatar Dec 17 '25 10:12 aiwenmo

If the task is executed in local mode, it will significantly increase the number of threads.

aiwenmo avatar Dec 17 '25 11:12 aiwenmo