Integration test with cloud-hosted system

[StrikeW]

Is your feature request related to a problem? Please describe.

Right now we only have the integration test with upstream and downstream system deployed via docker compose. But we also support source and sink of cloud-hosted system, e.g. AWS MSK, AWS RDS, etc. But we haven't setup integration test environment for those cloud-hosted systems.

Describe the solution you'd like

@neverchanje is investigating the solution right now, and we can use this thread to update the status.

I think there could be three options:

• I heard that cloud team has integration test with RisingWave kernel, maybe the cloud team can provision those cloud-hosted system in their pipeline and then we can run the integration test.
• Setup the pipeline environment in the kernel repo
• Use LocalStack to mimic the cloud environment, but I am not sure whether it can simulate an exact environment as the real cloud

Feel free to leave your comments. cc @lmatz @fuyufjh @hzxa21 @huangjw806

Describe alternatives you've considered

No response

Additional context

No response

[lmatz]

I was thinking if we can use localstack in per-pr or integration tests in this Repo.

And testing team also set up real cloud services on AWS or GCP to do a more real but also more costly tests e.g. running longevity occasionally when we release a major version

[neverchanje]

@neverchanje is investigating the solution right now, and we can use this thread to update the status.

I only investigated the pricing and it seemed that the price of hosting a free-tier RDS for testing won't be very high, compared to ec2 cost.

I agree with Martin. We can try localstack first. If not satisfied, we can purchase a real cloud service.

[github-actions[bot]]

This issue has been open for 60 days with no activity. Could you please update the status? Feel free to continue discussion or close as not planned.