kyuubi
kyuubi copied to clipboard
[KYUUBI #3773][FLINK] Support Flink Python UDF
Why are the changes needed?
Python support version of Flink matrix: Flink 1.14: Python 3.6, 3.7 or 3.8 Flink 1.15: Python 3.6, 3.7 or 3.8 Flink 1.16: Python 3.6, 3.7, 3.8 or 3.9
How was this patch tested?
-
[ ] Add some test cases that check the changes thoroughly including negative and positive cases if possible
-
[ ] Add screenshots for manual tests if appropriate
-
[X] Run test locally before make a pull request
Codecov Report
Merging #3779 (1142665) into master (7644849) will decrease coverage by
0.13%. The diff coverage is100.00%.
:exclamation: Current head 1142665 differs from pull request most recent head 6e8541b. Consider uploading reports for the commit 6e8541b to get more accurate results
@@ Coverage Diff @@
## master #3779 +/- ##
============================================
- Coverage 53.31% 53.19% -0.13%
Complexity 13 13
============================================
Files 577 569 -8
Lines 31584 31060 -524
Branches 4248 4194 -54
============================================
- Hits 16838 16521 -317
+ Misses 13156 12985 -171
+ Partials 1590 1554 -36
| Impacted Files | Coverage Δ | |
|---|---|---|
| ...ache/kyuubi/engine/flink/FlinkProcessBuilder.scala | 73.52% <100.00%> (+2.10%) |
:arrow_up: |
... and 71 files with indirect coverage changes
:mega: We’re building smart automated test selection to slash your CI/CD build times. Learn more
What's the Flink Python version support matrix? Do you suppose to let Kyuubi fully match?
What's the Flink Python version support matrix? Do you suppose to let Kyuubi fully match?
The Python version of Flink is unrelated to Kyuubi. Users can refer to Flink Python version support and set the python.executable option to specify the Python interpreter version.
So Kyuubi Flink SQL engine can ignore the Flink Python version problem.
I have checked out CI failed. I need to install the pyflink module in Python of the CI environment.
Kyuubi 1.9 goes to support Flink 1.16 to 1.19, would you like to rebase this PR and switch to python 3.9?