ipex-llm
ipex-llm copied to clipboard
Orca: add compile_args_creator in distributed training
Description
This PR is to add compile_args_creator
support in distributed training of tf2 ray/pyspark estiamtor.
YARN validation(cluster mode): ray backend: http://172.16.0.105:8088/cluster/app/application_1646614241228_2178 spark backend: http://172.16.0.105:8088/cluster/app/application_1646614241228_2181
YARN validation(client mode): ray backend: http://172.16.0.105:8088/cluster/app/application_1646614241228_2183 spark backend: http://172.16.0.105:8088/cluster/app/application_1646614241228_2182