[FLINK-33926][kubernetes]: Allow using job jars in the system classpath in native mode
What is the purpose of the change
This PR removes the verification for pipeline.jars if the option is not set, which allows using job jars in system classpath. FLINK-29288 has resolved this already for standalone mode, however in native mode, it currently results in NullPointerException.
This PR resolves both https://issues.apache.org/jira/browse/FLINK-33926 and https://issues.apache.org/jira/browse/FLINK-36137
Verifying this change
This change added a new unit test that executes deployment without pipeline.jars and checks no exception is thrown.
I have ran mvn verify for the module and passed existing tests for kubernetes module.
I've also deployed an operator with a custom Docker image built based on this branch in minikube environment. I confirmed that my custom Flink Docker image with a job jar in /opt/flink/lib can be executed successfully.
Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (no)
- The public API, i.e., is any changed class annotated with
@Public(Evolving): (no) - The serializers: (no)
- The runtime per-record code paths (performance sensitive): (no)
- Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Kubernetes/Yarn, ZooKeeper: ( no )
- The S3 file system connector: (no)
Documentation
- Does this pull request introduce a new feature? (no)
- If yes, how is the feature documented? (not applicable )
The pipeline.jars argument is already documented as an optional, but not required argument to provide. The doc says, if this option is not specified, jars in system classpath will be used. This is not true for native mode currently.
CI report:
- b8fb2923ad5c958a7af8664f536effb987aad16f Azure: SUCCESS
Bot commands
The @flinkbot bot supports the following commands:@flinkbot run azurere-run the last Azure build
This PR is being marked as stale since it has not had any activity in the last 90 days. If you would like to keep this PR alive, please leave a comment asking for a review. If the PR has merge conflicts, update it with the latest from the base branch.
If you are having difficulty finding a reviewer, please reach out to the community, contact details can be found here: https://flink.apache.org/what-is-flink/community/
If this PR is no longer valid or desired, please feel free to close it. If no activity occurs in the next 30 days, it will be automatically closed.
This PR still needs a review from a maintainer.