datafusion-ballista icon indicating copy to clipboard operation
datafusion-ballista copied to clipboard

Design: Implement bubble execution mode.

Open liurenjie1024 opened this issue 3 years ago • 2 comments

Is your feature request related to a problem or challenge? Please describe what you are trying to do. Currently ballista uses schedules stage by stage, which is great for fault tolerance, but inefficient for adhoc olap execution. Bubble execution mode is to make ballista more efficient for adhoc olap queries which doesn't require fault tolerance.

Describe the solution you'd like The detailed design can be found here, welcome to comment and share your thoughts.

Describe alternatives you've considered No.

Additional context No.

liurenjie1024 avatar Oct 20 '22 02:10 liurenjie1024

Very good proposal. Can you add some designs of popular systems such as Presto and Clickhouse for comparison?

r4ntix avatar Oct 20 '22 12:10 r4ntix

Very good proposal. Can you add some designs of popular systems such as Presto and Clickhouse for comparison?

Good suggestion, I'll add later.

liurenjie1024 avatar Oct 20 '22 13:10 liurenjie1024