matrixone icon indicating copy to clipboard operation
matrixone copied to clipboard

[Feature Request]: Integration Testing Framework Extensions

Open zhangxu19830126 opened this issue 2 years ago • 3 comments

Is there an existing issue for the same feature request?

  • [X] I have checked the existing issues.

Is your feature request related to a problem?

No

Describe the feature you'd like

Adding network partition isolation and the ability to independently start and stop individual nodes to the integrated test framework

Describe implementation you've considered

No response

Documentation, Adoption, Use Case, Migration Strategy

No response

Additional information

No response

zhangxu19830126 avatar Jul 15 '22 02:07 zhangxu19830126

Support the basic operation and awareness methods, then we could add more necessary convenient methods in order to support more flexible test purpose.

cnutshell avatar Jul 30 '22 01:07 cnutshell

With PR #4311, we have found different bugs or flaws, which is the exact purpose of this service integration test framework. The related bug or flaw could be learned from PR #4324, PR #4318, and issue #4334.

There should be another issue created, But I fixed that issue manually in this PR #4311 within commit 73decf2, as a result of the slow pace of issue -> PR -> merge.

In view of this, I've change the plan to accomplish this integration test framework. And the pre-defined timeline should be rectified also.

cnutshell avatar Aug 03 '22 01:08 cnutshell

Now, I've implemented basic features for this test framework. Next, I will continue on the simulation of network partition.

The timeline seems to be longer than expected, but in the development of test framework, there are different issues discovered and repaired. That's the exact purpose of developing such an integration test framework. I think that's OK.

cnutshell avatar Aug 12 '22 07:08 cnutshell

For network partition feature in this integration test framework, we implement logic at the side of morpc.Client by taking advantage of its option morpc.WithBackendFilter.

cnutshell avatar Aug 18 '22 06:08 cnutshell

All the basic features were completed. There may be some necessary updates needed in order to cope with practical requirements when using this framework.

cnutshell avatar Aug 19 '22 15:08 cnutshell