flink icon indicating copy to clipboard operation
flink copied to clipboard
verified publisher icon apache

[FLINK-35282][python] Upgrade Apache Beam > 2.54

Open xaniasd opened this issue 1 year ago • 1 comments

What is the purpose of the change

Based on #24908, upgrade Apache Beam dependency to >2.54.

Brief change log

Changes flink-python code and tests for compatibility with new version, updates licenses and relevant documentation in other components.

Verifying this change

This change is already covered by existing tests.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): yes
  • The public API, i.e., is any changed class annotated with @Public(Evolving): no
  • The serializers: no
  • The runtime per-record code paths (performance sensitive): no
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
  • The S3 file system connector: no

Documentation

  • Does this pull request introduce a new feature? no
  • If yes, how is the feature documented? not applicable

xaniasd avatar Oct 16 '24 21:10 xaniasd

CI report:

  • b9350f12146457ba59a83df890967645ed98a1f8 Azure: FAILURE
Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

flinkbot avatar Oct 16 '24 21:10 flinkbot

@dianfu , @HuangXingBo could you please have a look here, I think you are more experienced with python in Flink

snuyanzin avatar Nov 21 '24 05:11 snuyanzin

Any update on this? @dianfu @HuangXingBo @snuyanzin ?

franciscojavierarceo avatar Dec 27 '24 19:12 franciscojavierarceo

Sorry for late response. I will take a look at this PR.

dianfu avatar Jan 09 '25 14:01 dianfu

@xaniasd I see that it added a lot of doc files in this PR. Why we need to do this?

dianfu avatar Jan 13 '25 03:01 dianfu

hi @dianfu I think these doc files were generated by sphinx while running flink-python/dev/lint-python.sh and I assume they reflect corresponding changes in the pyflink API.

xaniasd avatar Jan 13 '25 09:01 xaniasd

@xaniasd These changes are not necessary. It will generate these files by default during generating the Python API website. Could you remove them from the PR?

dianfu avatar Jan 13 '25 12:01 dianfu

removed @dianfu, thanks for clarifying. Perhaps we could add those api directories to .gitignore to avoid confusion in the future?

xaniasd avatar Jan 13 '25 13:01 xaniasd