ipex-llm icon indicating copy to clipboard operation
ipex-llm copied to clipboard
verified publisher icon intel-analytics

Facing issue when running autoprophet function using apache/spark-py:v3.4.0

Open SjeYinTeoIntel opened this issue 1 year ago • 1 comments

Environment testing in docker image using: docker image tag: apache/spark-py:v3.4.0 pyspark==3.1.3 ray=2.6.3 ENV PYTHONPATH=/opt/spark/python/lib/pyspark.zip:/opt/spark/python/lib/py4j-.zip

py4j version in this image is py4j-0.10.9.7-src.zip image

code part: image

Issue happened in two place. after i print "Done init_orca_context"

image

another one is when it showing stopping orca context image

SjeYinTeoIntel avatar Jan 23 '24 07:01 SjeYinTeoIntel

The exception might be caused by environment issues related to the image.

  1. Incompatibility between the Py4J version and PySpark version.
  2. Ensure that the Py4J protocol versions used by the Java and Python sides are consistent.

sgwhat avatar Jan 24 '24 01:01 sgwhat