flink icon indicating copy to clipboard operation
flink copied to clipboard

[FLINK-37328][FileSystems] Upgrade GCS connector to 2.2.26.

Open cnauroth opened this issue 10 months ago • 4 comments

What is the purpose of the change

Upgrade GCS connector to 2.2.26.

Brief change log

Upgrade the GCS Connector bundled in the Flink distro from version 2.2.18 to 2.2.26.

Release Notes

Verifying this change

This change is already covered by existing tests. I also have the new integration tests from #26102 patched in locally. (I would prefer for that test PR to be merged first, so that we have more testing confidence on these upgrades in the future.)

mvn -Pfast -pl flink-filesystems/flink-gs-fs-hadoop clean verify

For testing the documentation changes, I attempted to build locally, but I encountered an unrelated error that I haven't investigated yet.

cd docs
./build_docs.sh -p
...
ERROR render of "section" failed: "/usr/local/google/home/cnauroth/git/apache/flink/docs/layouts/_default/baseof.html:24:5": execute of template failed: template: _default/list.html:24:5: executing "_default/list.html" at <partial "docs/html-head" .>: error calling partial: execute of template failed: html/template:partials/docs/html-head.html:33:13: no such template "_internal/google_analytics_async.html"

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): yes
  • The public API, i.e., is any changed class annotated with @Public(Evolving): no
  • The serializers: no
  • The runtime per-record code paths (performance sensitive): no
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: no
  • The S3 file system connector: no (but yes to the GCS connector)

Documentation

  • Does this pull request introduce a new feature? no
  • If yes, how is the feature documented? not applicable

cnauroth avatar Feb 15 '25 00:02 cnauroth

CI report:

  • 038e09cb672b8c234da20de9429ad268c9082a8b Azure: FAILURE
Bot commands The @flinkbot bot supports the following commands:
  • @flinkbot run azure re-run the last Azure build

flinkbot avatar Feb 15 '25 00:02 flinkbot

It looks like the CI failure is an unrelated test failure in TableSinkITCase#testSinkDisorderChangeLogWithRank.

cnauroth avatar Feb 15 '25 19:02 cnauroth

+1 (non-binding). This PR updates various versions of the gcs connector to keep it in sync with the latest changes.

jayadeep-jayaraman avatar Mar 11 '25 03:03 jayadeep-jayaraman

I would still like to contribute this PR. I'll reach out to [email protected] to ask for help with review.

cnauroth avatar May 27 '25 20:05 cnauroth

This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review. If the PR has merge conflicts, update it with the latest from the base branch.

If you are having difficulty finding a reviewer, please reach out to the community, contact details can be found here: https://flink.apache.org/what-is-flink/community/

If this PR is no longer valid or desired, please feel free to close it. If no activity occurs in the next 30 days, it will be automatically closed.

github-actions[bot] avatar Aug 26 '25 06:08 github-actions[bot]

I'm still intending to get this one in, pending #26102 as a pre-requisite. I think we're getting closer on that one.

CC: @rmetzger

cnauroth avatar Aug 26 '25 20:08 cnauroth

This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review. If the PR has merge conflicts, update it with the latest from the base branch.

If you are having difficulty finding a reviewer, please reach out to the community, contact details can be found here: https://flink.apache.org/what-is-flink/community/

If this PR is no longer valid or desired, please feel free to close it. If no activity occurs in the next 30 days, it will be automatically closed.

github-actions[bot] avatar Nov 25 '25 06:11 github-actions[bot]