spark-docker icon indicating copy to clipboard operation
spark-docker copied to clipboard

[SPARK-53471] Correct entrypoint.sh for Openshift

Open Reamer opened this issue 4 months ago • 1 comments

What changes were proposed in this pull request?

This change performs string interpolation during the creation of the temporary file.

Why are the changes needed?

Start problems due to incorrect evaluation of the content.

Exception in thread "main" java.lang.IllegalArgumentException: basedir must be absolute: -anonymous uid}/.ivy2/local
	at org.apache.ivy.util.Checks.checkAbsolute(Checks.java:48)
	at org.apache.ivy.plugins.repository.file.FileRepository.setBaseDir(FileRepository.java:137)
	at org.apache.ivy.plugins.repository.file.FileRepository.<init>(FileRepository.java:44)
	at org.apache.spark.deploy.SparkSubmitUtils$.createRepoResolvers(SparkSubmit.scala:1269)
	at org.apache.spark.deploy.SparkSubmitUtils$.buildIvySettings(SparkSubmit.scala:1376)
	at org.apache.spark.util.DependencyUtils$.resolveMavenDependencies(DependencyUtils.scala:182)
	at org.apache.spark.deploy.SparkSubmit.prepareSubmitEnvironment(SparkSubmit.scala:334)
	at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:964)
	at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:176)
	at org.apache.spark.deploy.SparkSubmit$$anon$1.run(SparkSubmit.scala:174)
	at java.base/java.security.AccessController.doPrivileged(Native Method)
	at java.base/javax.security.auth.Subject.doAs(Subject.java:423)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1878)
	at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:174)
	at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:217)
	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91)
	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1120)
	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1129)
	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

Does this PR introduce any user-facing change?

No

How was this patch tested?

On my Openshift 4.17 platform

Reamer avatar Sep 03 '25 07:09 Reamer

ping @Yikun and @pan3793

Reamer avatar Sep 03 '25 07:09 Reamer