flink icon indicating copy to clipboard operation
flink copied to clipboard

[FLINK-33856][checkpointing] Add metrics for interaction performance with external storage system in the process of checkpoint making

Open hejufang opened this issue 1 year ago • 1 comments

What is the purpose of the change

Add metrics for interaction performance with external storage system in the process of checkpoint making.

Brief change log

When FsCheckpointStreamFactory interaction with external storage system, statistical write file and close the file, and report the metrics.

Verifying this change

  • This change added tests and can be verified as follows:
org.apache.flink.runtime.state.filesystem.FsCheckpointStreamFactoryTest#testCheckpointFileAccessStatistic

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): no
  • The public API, i.e., is any changed class annotated with @Public(Evolving): no
  • The serializers: no
  • The runtime per-record code paths (performance sensitive): no
  • Anything that affects deployment or recovery: no
  • The S3 file system connector: no

Documentation

  • Does this pull request introduce a new feature? yes
  • If yes, how is the feature documented? not documented

hejufang avatar Dec 25 '23 13:12 hejufang

CI report:

  • 11b92cc0b93cabe4e4019b569865f208482198de Azure: SUCCESS
Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

flinkbot avatar Dec 25 '23 13:12 flinkbot