tispark icon indicating copy to clipboard operation
tispark copied to clipboard

[BUG] tispark任务启动延迟

Open zzppingcap opened this issue 3 years ago • 4 comments

Describe the bug 5.1.1集群tispark任务启动延迟,延迟几十秒或两三分钟启动,在3.0集群上没这个现象。

zzppingcap avatar Feb 07 '22 06:02 zzppingcap

/lifecycle frozen

shiyuhang0 avatar Apr 27 '22 10:04 shiyuhang0

https://github.com/pingcap/tispark/issues/2331

xuanyu66 avatar May 12 '22 08:05 xuanyu66

https://github.com/pingcap/tispark/issues/959

xuanyu66 avatar May 12 '22 08:05 xuanyu66

This phenomenon is induced by two reasons. First, in the case of high concurrency, the locks on the regionCache are locked for a long time due to competition. Second, the original regionCache has a low hit rate, which causes a large number of rpc requests. These two problems have been solved by https://github.com/pingcap/tispark/pull/2106 and https://github.com/pingcap/tispark/pull/1987. In version 2.5 and later, the problem no longer exists.

qidi1 avatar Aug 29 '22 13:08 qidi1