shadowinlife comments

Repositories
Issues
Comments

Results 5 comments of


                                            shadowinlife

mpirun failed with exit status 1 while running spark submit with master yarn on horovod

Any guys resolved this? I catch same issue with spark 3.2.0 on k8s

Spark operator support scheduled log write to S3

With a `sidecar` or just a `jvm thread` collect logs of pod and append to s3 files is a alternative for this scope. And worked well in my production k8s....

WIP: to #2708 feat add manager product extension point for controller startup

temporary close for need more tests on my k8s environment

[feat] Distributed informer SparkAppliction resources by labels

Working.... Thanks for suggestions

[feat] Distributed informer SparkAppliction resources by labels

Thanks, then I think I can created a factory method for `manager starter` action. Then for most `spark-operator` user, the default `informer` not changed. For some user need solutions like...