[KYUUBI #6449] Fix Gluten CI ClassNotFoundException: io.glutenproject.GlutenPlugin

[zhouyifan279]

:mag: Description

Issue References 🔗

This pull request fixes Gluten CI Error ClassNotFoundException: io.glutenproject.GlutenPlugin

Describe Your Solution 🔧

Change spark.plugins's property value from io.glutenproject.GlutenPlugin to org.apache.gluten.GlutenPlugin.

Types of changes :bookmark:

• [x] Bugfix (non-breaking change which fixes an issue)
• [ ] New feature (non-breaking change which adds functionality)
• [ ] Breaking change (fix or feature that would cause existing functionality to change)

Test Plan 🧪

Behavior Without This Pull Request :coffin:

Behavior With This Pull Request :tada:

Related Unit Tests

---

Checklist 📝

• [x] This patch was not authored or co-authored using Generative Tooling

Be nice. Be informative.

[zhouyifan279]

@pan3793 How can I tigger Gluten CI in this PR ?

[pan3793]

You can modify https://github.com/apache/kyuubi/blob/1fb1f854eb40e19dfaad86192017b8b4efd9a2c4/.github/workflows/gluten.yml#L20-L22

[zhouyifan279]

You can modify

https://github.com/apache/kyuubi/blob/1fb1f854eb40e19dfaad86192017b8b4efd9a2c4/.github/workflows/gluten.yml#L20-L22

@pan3793 Thanks. I was hoping there was a button on some web page. But it looks like there is no such button.

[pan3793]

technically, we can allow the job to be triggered manually, then there will be a button.

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 0.00%. Comparing base (1fb1f85) to head (284861d). Report is 29 commits behind head on master.

:exclamation: Current head 284861d differs from pull request most recent head a3415c8

Please upload reports for the commit a3415c8 to get more accurate results.

:exclamation: There is a different number of reports uploaded between BASE (1fb1f85) and HEAD (284861d). Click for more details.

HEAD has 5 uploads less than BASE

Flag	BASE (1fb1f85)	HEAD (284861d)
	6	1

Additional details and impacted files

@@             Coverage Diff              @@
##             master   #6449       +/-   ##
============================================
- Coverage     58.34%   0.00%   -58.35%     
============================================
  Files           656     677       +21     
  Lines         40264   41734     +1470     
  Branches       5498    5704      +206     
============================================
- Hits          23493       0    -23493     
- Misses        14272   41734    +27462     
+ Partials       2499       0     -2499     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

[pan3793]

I don't have further questions, would like @ulysses-you to take a look.

[zhouyifan279]

@pan3793 @ulysses-you I have fixed the errors in gluten project build script ./dev/package.sh and use it in kyuubi's gluten ci to generate both gluten jars and gluten libs(.so files). Job gluten-build now works fine.

But Job gluten-it always throws the following error:

#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007f47b5c75994, pid=24169, tid=0x00007f47237ff640
#
# JRE version: OpenJDK Runtime Environment (8.0_412-b08) (build 1.8.0_412-b08)
# Java VM: OpenJDK 64-Bit Server VM (25.412-b08 mixed mode linux-amd64 compressed oops)
# Problematic frame:
# C  [libgcc_s.so.1+0x14994]  _Unwind_GetTextRelBase+0x4
#
# Core dump written. Default location: /home/runner/work/kyuubi/kyuubi/integration-tests/kyuubi-gluten-it/core or core.24169
#
# An error report file with more information is saved as:
# /home/runner/work/kyuubi/kyuubi/integration-tests/kyuubi-gluten-it/hs_err_pid24169.log
#
# If you would like to submit a bug report, please visit:
#   https://github.com/adoptium/adoptium-support/issues
# The crash happened outside the Java Virtual Machine in native code.
# See problematic frame for where to report the bug.
#

It seems to be caused by Gluten's cpp code. I'm not familiar with Gluten's cpp code. I hope we can have a gluten expert to fix this.

I've uploaded the jvm error report files as artifacts. It may help the debugging.

• gluten-it-spark-3.3: https://github.com/apache/kyuubi/actions/runs/9647616234/artifacts/1632774211
• gluten-it-spark-3.4: https://github.com/apache/kyuubi/actions/runs/9647616234/artifacts/1632774213

[github-actions[bot]]

Thanks for the PR! This PR is being closed due to inactivity. This isn't a judgement on the merit of the PR in any way. If this is still an issue with the latest version of Kyuubi, please reopen it and ask a committer to remove the Stale tag!

Thank you for using Kyuubi!