flink icon indicating copy to clipboard operation
flink copied to clipboard

[FLINK-34508][ci] Migrates S3 ITCases to Minio tests

Open morazow opened this issue 11 months ago • 1 comments

What is the purpose of the change

Migrates S3 related ITCases and E2E tests to use Minio test container.

Brief change log

  • Removes S3TestCredentials class from S3 related integration tests
  • Adds MinioTestContainer to provide S3 credentials and filesystem initialization
  • Enable test container reuse for MinioTestContainer
  • Refactored JUnit4 from JUnit5 on changed classes
  • TODO: Removes S3 related environment (e.g, IT_CASE_S3_*) variables

Verifying this change

  • Azure CI pipelines should build successfully
  • GitHub Actions should build successfully

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): no
  • The public API, i.e., is any changed class annotated with @Public(Evolving): no
  • The serializers: no
  • The runtime per-record code paths (performance sensitive): no
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
  • The S3 file system connector: no
    • The test files of S3 file system changes

Documentation

  • Does this pull request introduce a new feature? no
  • If yes, how is the feature documented? not applicable

morazow avatar Mar 01 '24 12:03 morazow

CI report:

  • 7f833c04c444d4870be16b310ce627acf16687d9 Azure: SUCCESS
Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

flinkbot avatar Mar 01 '24 12:03 flinkbot