Eric Liang comments

Results 61 comments of


                                            Eric Liang

[core][nightly] many_actors regression

Could we also optimize the query? It seems we spend a lot of time constructing some rpc::Address protobuf, when we just want to check if the owner is present. Also,...

[core] Delete gcs heartbeat manager

LGTM minus test failures

[WIP][Datasets] Enable lazy execution by default

Nice. Shall we also update the documentation in the same change?

[WIP][Datasets] Enable lazy execution by default

FWIW, getting rid of the first block reading would also help with integrating fully streaming execution (right now actually that breaks streaming actually). How about we do that as a...

[WIP] Prototype splitting blocks to ensure requested read parallelism is always met

This is ready for review.

[WIP] Prototype splitting blocks to ensure requested read parallelism is always met

Updated.

[WIP] Prototype splitting blocks to ensure requested read parallelism is always met

Merging so we can test in master. Let's discuss the future of split blocks as an operator separately.

[data] Spread map task stages by default for arg size <50MB

I expect the regression will be significant, but I don't know of any real workload that we can test in particular. I'm not sure it's meaningful to test it, given...

[data] Spread map task stages by default for arg size <50MB

Sounds good, I'll start with a 50MB threshold.

[Data] [no_early_kickoff] Change autoscaling logic to use free slots and input queue size

Ping on this one.