matrixone icon indicating copy to clipboard operation
matrixone copied to clipboard

[Bug]: Resource consumption decreases for the same SQL as CN scales out

Open DanielZhangQD opened this issue 1 year ago • 18 comments

Is there an existing issue for the same bug?

  • [X] I have checked the existing issues.

Branch Name

1.1-dev

Commit ID

e82e8634e

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

Run TPCH Q1 continuously and CN scales out, however, as the SQL runs, the resource consumption decreases for each SQL:

MySQL [mo_cloud]> select statement_id,request_at,stats,duration from system.statement_info where request_at >= '2024-01-16 09:20:00' and statement_id = '9fbcb619-b451-11ee-ab0d-5a793b855f27';
+--------------------------------------+----------------------------+-------------------------------------------+------------+
| statement_id                         | request_at                 | stats                                     | duration   |
+--------------------------------------+----------------------------+-------------------------------------------+------------+
| 9fbcb619-b451-11ee-ab0d-5a793b855f27 | 2024-01-16 09:28:36.035840 | [3,29257374651,9793388020.000,0,0,1215,2] | 3742379779 |
+--------------------------------------+----------------------------+-------------------------------------------+------------+
1 row in set (0.01 sec)

MySQL [mo_cloud]> select statement_id,request_at,stats,duration from system.statement_info where request_at >= '2024-01-16 09:20:00' and statement_id = 'dde96a1d-b452-11ee-ab0d-5a793b855f27';
+--------------------------------------+----------------------------+-------------------------------------------+-----------+
| statement_id                         | request_at                 | stats                                     | duration  |
+--------------------------------------+----------------------------+-------------------------------------------+-----------+
| dde96a1d-b452-11ee-ab0d-5a793b855f27 | 2024-01-16 09:37:29.844278 | [3,21447305605,9793388020.000,0,0,1215,2] | 620723372 |
+--------------------------------------+----------------------------+-------------------------------------------+-----------+
1 row in set (0.02 sec)

Expected Behavior

Resource consumption is stable or increases a little bit

Steps to Reproduce

See detail in `Actual Behavior`

Additional information

Refer to https://github.com/matrixorigin/MO-Cloud/issues/2337

DanielZhangQD avatar Jan 16 '24 10:01 DanielZhangQD

no process

nnsgmsone avatar Jan 19 '24 10:01 nnsgmsone

处理生产环境的问题中

nnsgmsone avatar Jan 24 '24 10:01 nnsgmsone

no process

nnsgmsone avatar Jan 29 '24 10:01 nnsgmsone

no process

nnsgmsone avatar Feb 01 '24 10:02 nnsgmsone

no process

nnsgmsone avatar Feb 21 '24 13:02 nnsgmsone

no process

nnsgmsone avatar Feb 26 '24 10:02 nnsgmsone

处理数据正确性问题中

nnsgmsone avatar Feb 29 '24 10:02 nnsgmsone

no process

nnsgmsone avatar Mar 05 '24 10:03 nnsgmsone

无进展

ouyuanning avatar Apr 03 '24 10:04 ouyuanning

无进展

ouyuanning avatar Apr 08 '24 11:04 ouyuanning

无进展

ouyuanning avatar Apr 11 '24 10:04 ouyuanning

无进展

ouyuanning avatar Apr 19 '24 14:04 ouyuanning

在处理prepare重构

ouyuanning avatar Apr 24 '24 12:04 ouyuanning

在处理prepare重构

ouyuanning avatar Apr 29 '24 12:04 ouyuanning

在处理prepare重构

ouyuanning avatar May 06 '24 11:05 ouyuanning

在处理prepare重构,还没时间看

ouyuanning avatar May 09 '24 10:05 ouyuanning

在处理prepare重构,还没时间看

ouyuanning avatar May 14 '24 11:05 ouyuanning

在处理prepare重构,还没时间看

ouyuanning avatar May 17 '24 11:05 ouyuanning

在处理prepare重构,还没时间看

ouyuanning avatar May 22 '24 11:05 ouyuanning

辛苦喜亮后面继续跟进吧

ouyuanning avatar May 27 '24 12:05 ouyuanning

后面继续跟进

qingxinhome avatar May 31 '24 13:05 qingxinhome

后面继续跟进

qingxinhome avatar Jun 06 '24 13:06 qingxinhome

not working on it

qingxinhome avatar Jun 13 '24 12:06 qingxinhome

not working on it

qingxinhome avatar Jun 19 '24 14:06 qingxinhome

not working on it

qingxinhome avatar Jun 24 '24 14:06 qingxinhome

not working on it

qingxinhome avatar Jun 28 '24 13:06 qingxinhome

not working on it

qingxinhome avatar Jul 04 '24 12:07 qingxinhome

not working on it

qingxinhome avatar Jul 10 '24 14:07 qingxinhome

代码梳理重构中

qingxinhome avatar Jul 16 '24 11:07 qingxinhome

从提供的数据看,随着CN扩展, sql执行CPU时间消耗发生下降

qingxinhome avatar Jul 17 '24 02:07 qingxinhome