jordanFisherYzw

error while running mnist_tf_ds.py

1

requirement.txt tensorflow==2.10.0 tensorflow-datasets tensorflow-io 2023-09-23 06:57:51,595 WARNING (MainThread-18213) From mnist_tf_ds.py:36: _CollectiveAllReduceStrategyExperimental.__init__ (from tensorflow.python.distribute.collective_all_reduce_strategy) is deprecated and will be removed in a future version. Instructions for updating: use distribute.MultiWorkerMirroredStrategy instead 2023-09-23...

yarn mode error

1

when I run the yarn mode according to https://github.com/yahoo/TensorFlowOnSpark/wiki/GetStarted_YARN echo $KRYLOV_WF_HOME echo $KRYLOV_WF_TASK_NAME/$1 export PYTHON_ROOT=./Python export LD_LIBRARY_PATH=${PATH} export PYSPARK_PYTHON=${PYTHON_ROOT}/bin/python3 export SPARK_YARN_USER_ENV="PYSPARK_PYTHON=Python/bin/python3" export PATH=${PYTHON_ROOT}/bin/:$PATH export SPARK_WORKER_INSTANCES=4 export CORE_PER_WORKERS=2 export TOTAL_CORES=$((${CORE_PER_WORKERS}*${SPARK_WORKER_INSTANCES})) /apache/releases/spark-3.1.1.0.9.0-bin-ebay/bin/spark-submit...