Xianyang Liu comments

Results 62 comments of


                                            Xianyang Liu

Usage behind a proxy

Any update on this ?

ARROW-17338: [Java] The maximum request memory of BaseVariableWidthVector should limit to Integer.MAX_VALUE

Hi @pitrou, could you help to review this when you are free? Thanks a lot.

ARROW-17338: [Java] The maximum request memory of BaseVariableWidthVector should limit to Integer.MAX_VALUE

Thanks, @pitrou @lwhite1 for your time to review this. The UT has been added. Please take another look when you are free. Thanks again.

ARROW-17338: [Java] The maximum request memory of BaseVariableWidthVector should limit to Integer.MAX_VALUE

Thanks, @pitrou for merging this. And also thanks to everyone for the time to review this.

not stable when using ray client mode

It seems like the error message not forward well by the ray client?

use ray java snapshot version

The memory unit has changed. You can refer here https://github.com/oap-project/raydp/pull/106/files

use ray java snapshot version

The ray 1.3.0 has released, should we just need to support ray 1.3.0 in the master branch?

use ray java snapshot version

Hi @kira-lin, should we merge this into the master branch first?

Question regarding Dynamic Executor Allocation support for Spark

Hi @dpittner. Yeah, we have not supported dynamic executor allocation currently. We will add it support recently. If you use `spark on ray` only, it should be easy to add...

Can't init spark on multi-nodes ray cluster on k8s

hi @valiantljk, could you try #77 for this issue? It works for me on k8s (1 master node, 2 worker nodes). Also cc @carsonwang