flink icon indicating copy to clipboard operation
flink copied to clipboard

[FLINK-33389][runtime] Support tasks balancing at slot level for Adaptive Scheduler

Open RocMarshal opened this issue 1 year ago • 3 comments

What is the purpose of the change

[FLINK-33389][runtime] Support tasks balancing at slot level for Adaptive Scheduler

Brief change log

  • Introduce the SlotSharingStrategy and related implementations for the original slot sharing strategy and tasks balanced slot sharing strategy.
  • Add CoLocationGroup related methods for JobInformation, VertexInformation
  • Do some related adaption lines.

Verifying this change

This change is already covered by existing tests,

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): (yes / no)
  • The public API, i.e., is any changed class annotated with @Public(Evolving): (yes / no)
  • The serializers: (yes / no / don't know)
  • The runtime per-record code paths (performance sensitive): (yes / no / don't know)
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: (yes / no / don't know)
  • The S3 file system connector: (yes / no / don't know)

Documentation

  • Does this pull request introduce a new feature? (yes / no)
  • If yes, how is the feature documented? (not applicable / docs / JavaDocs / not documented)

RocMarshal avatar Oct 13 '24 13:10 RocMarshal

Hi, @1996fanrui Could you help take a look ? many thx~

RocMarshal avatar Oct 13 '24 13:10 RocMarshal

CI report:

  • 07218839185a289e2bf159d7d5b9e5e670ca487a Azure: SUCCESS
Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

flinkbot avatar Oct 13 '24 13:10 flinkbot

Hi, @1996fanrui @huyuanfeng2018 Could you help take a look if you had the free time ? Many thanks !

RocMarshal avatar Nov 17 '24 06:11 RocMarshal

Hi, @ferenc-csaky Could you help take a look at this ? Any input is appreciated~

RocMarshal avatar Jul 01 '25 02:07 RocMarshal