jay
jay
> thanks for your contribution. Could you elaborate on why np.array_split would produce uneven and non-deterministic results? I tried the following script, the splits are even. > > ``` >...
> do you know why np.array_split is slow? Also, I'm curious about your use cases. This operation is done only once upon job start-up. 10s of ms latency increase doesn't...
> then maybe let's not introduce this change and just remove _split_list done
@westonpace @wjones127 WDYT?
@westonpace Can we discuss here how to implement in this issue?
> @Jay-ju sounds good. I'm back from break as of yesterday and a better API for distributed add_columns is one of my top priorities. > > Adding columns is similar...
> > However, the Ray community believes that at this stage, they do not want to implement non-read-write operators. > > Therefore, I want to confirm here whether it is...
@westonpace Yes, this demo can be executed very well. We just need to confirm whether it needs to be maintained. If it needs to be maintained, submit a pull request...
> > Can we release a version based on fragments first and then optimize it? > > There is a fragment-level API for adding columns today (it has a different...
+1, Is there anyone willing to implement this part? It sounds very useful.