paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[spark] Refine paimon_sparkx_common dependency

Open jackylee-ch opened this issue 2 months ago • 0 comments

Purpose

While executing mvn test -Pspark4 -pl "org.apache.paimon:paimon-spark-4.0_2.13", I encountered a failure in the unit tests because paimon-spark3-common was being loaded. image Further investigation revealed that when running mvn dependency:tree -pl "org.apache.paimon:paimon-spark-4.0_2.13", I could see the paimon-spark3-common dependency brought in via paimon-spark-ut_2.13. The root cause is that the profile defined in paimon-spark-ut_2.13-1.4.0-SNAPSHOT.jar was not being propagated, which caused the default paimon-sparkx-common configuration to be applied. image

This PR resolves the issue by explicitly specifying the profile, ensuring that the profile metadata is passed along, and thus enabling mvn test -Pspark4 -pl "org.apache.paimon:paimon-spark-4.0_2.13" to run successfully.

Tests

GA

API and Format

No.

Documentation

No.

jackylee-ch avatar Oct 20 '25 12:10 jackylee-ch