shardingsphere-on-cloud icon indicating copy to clipboard operation
shardingsphere-on-cloud copied to clipboard

Published 20 hours ago • verified publisher icon apache

Introduce JVM chaos to ShardingSphere

Open mlycore opened this issue 1 year ago • 7 comments

Apache ShardingSphere

Apache ShardingSphere is positioned as a Database Plus, and aims at building a standard layer and ecosystem above heterogeneous databases. It focuses on how to reuse existing databases and their respective upper layer, rather than creating a new database. The goal is to minimize or eliminate the challenges caused by underlying databases fragmentation.

Page: https://shardingsphere.apache.org/ Github: https://github.com/apache/shardingsphere 

Background

There is a proposal about the background of ChaosEngineering as belows:

  • #32

And we also proposed a generic controller for ShardingSphereChaos as belows:

  • #272

The ShardingSphereChaos controller is aiming at different chaos tests. This JVMChaos is an important one.

Task

Write several scripts to implement different JVMChaos for main features of ShardingSphere. The specific case list is as follows.

  • [ ] Add scripts injecting chaos to DataSharding
  • [ ] Add scripts injecting chaos to ReadWritingSplitting
  • [ ] Add scripts injecting chaos to DatabaseDiscovery
  • [ ] Add scripts injecting chaos to Encryption
  • [ ] Add scripts injecting chaos to Mask
  • [ ] Add scripts injecting chaos to Shadow

Basically, these scripts will cause unexpected behaviour while executing the related. DistSQL.

Relevant Skills

  1. Master Go language, Ginkgo test framework
  2. Have a deep understanding of Apache ShardingSphere concepts and practices.
  3. JVM byte mechanisms like ByteMan, ByteBuddy.

Targets files

JVMChaos Scripts - https://github.com/apache/shardingsphere-on-cloud/chaos/jvmchaos/scripts/

mlycore avatar Mar 09 '23 05:03 mlycore

Please assign this issue to me ,thanks.

wbtlb avatar Mar 10 '23 08:03 wbtlb

Thanks @wbtlb

mlycore avatar Mar 10 '23 08:03 mlycore

In the native chaos mesh, the injection and chaos testing of the basic jvm are realized by writing byteman scripts. In order to realize the chaos test unique to ShardingSphere, there are some basic prerequisite tasks to do:

  • [ ] confirm ShardingSphere hook point and the architecture of ShardingSphere.
  • [ ] Write Byteman scripts for ShardingSphere.
  • [ ] Use ASM can implement complex dynamic pile load test.

wbtlb avatar Mar 10 '23 09:03 wbtlb

I'd like to help on this issue, assign it to me too, plz ;)

Jacob953 avatar Mar 13 '23 11:03 Jacob953

I'd like to help on this issue, assign it to me too, plz ;)

Thanks. This issue could be decomposed into smaller one. Please file a new issue and attach to this one.

mlycore avatar Mar 13 '23 14:03 mlycore

I think we should prepare not only the Chaos test itself, but also the load generator. Such as a Golang program which can continuously doing some DistSQL Job to ShardingSphere.

mlycore avatar Mar 14 '23 07:03 mlycore

https://github.com/apache/shardingsphere-on-cloud/issues/32#issuecomment-1471355157

mlycore avatar Mar 16 '23 05:03 mlycore