matrixone icon indicating copy to clipboard operation
matrixone copied to clipboard

[Bug]: update table mo_catalog.mo_mysql_compatibility_mode too slow

Open ck89119 opened this issue 1 year ago • 8 comments

Is there an existing issue for the same bug?

  • [X] I have checked the existing issues.

Branch Name

v1.1.3

Commit ID

95801d84d

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

以100qps 获取mo连接并执行一条简单sql select count(*) from t (t表只有一条数据),记录执行时间: image

上图左边是commit: 95801d84d 的执行时间,右边是commit: 14c4496c6,执行时间差距巨大,而且左边执行时间会越来越长。

它们在代码上的区别:左边在auth的时候需要执行两条update语句 update mo_catalog.mo_mysql_compatibility_mode set variable_value = '%s' where account_id = %d and variable_name = '%s';,右边不执行。

这是执行时抓取的cpu profile cpu top: image

flame graph: image

Expected Behavior

No response

Steps to Reproduce

1. 本地起mo
2. 以100qps的速度获取mo连接,执行一条简单sql

Additional information

No response

ck89119 avatar Apr 18 '24 08:04 ck89119

ref: https://github.com/matrixorigin/matrixone/pull/15560

aylei avatar Apr 19 '24 02:04 aylei

@daviszhen PTAL and triage

aylei avatar Apr 19 '24 02:04 aylei

未投入

daviszhen avatar Apr 24 '24 11:04 daviszhen

未投入

daviszhen avatar Apr 30 '24 10:04 daviszhen

未投入

daviszhen avatar May 05 '24 12:05 daviszhen

未投入

daviszhen avatar May 09 '24 10:05 daviszhen

未投入

daviszhen avatar May 14 '24 12:05 daviszhen

未投入

daviszhen avatar May 17 '24 12:05 daviszhen

未投入

daviszhen avatar May 22 '24 12:05 daviszhen

未投入

daviszhen avatar May 27 '24 12:05 daviszhen

未投入

daviszhen avatar May 30 '24 11:05 daviszhen

未投入

daviszhen avatar Jun 04 '24 11:06 daviszhen

系统变量调整后,再确认下。

daviszhen avatar Jun 04 '24 11:06 daviszhen

系统变量重构 #16551 完成后,每次登录鉴权不再会更新mo_mysql_compatibility_mode表。

在当前最新的1.2-dev分支(commit: ed9811a75),重新跑上面的测试,执行时间已经正常了:

image

ck89119 avatar Jun 13 '24 06:06 ck89119