Andy Grove comments

Results 251 comments of


                                            Andy Grove

Add a feature based object store provider

The approach here LGTM but I have not worked with the object store yet

Unsupported binary operator `StringConcat`

Hi @askoa. The bug that I fixed was related to logical plan serialization. This is part of the `datafusion-proto` crate that Ballista uses. You are right though .. we also...

Unsupported binary operator `StringConcat`

@askoa, I created a PR to add the missing operators, but I agree with your comments that we could leverage DataFusion rather than have duplicate code here. DataFusion has a...

Add REST endpoint to get DOT graph of a job

> Very nice! What generates the png? `http://localhost:50050/jobs//dot` serves up the raw dot file. I am converting to png locally. I would like the Web UI to just render this...

Add REST endpoint to get DOT graph of a job

@yahoNanJing @thinkharderdev @avantgardnerio This is now ready for review. I will follow up with smaller PRs to improve formatting and add metrics.

Add REST endpoint to get DOT graph of a job

Thanks for the review @Dandandan and @yahoNanJing

CLI uses DataFusion context if no host or port are provided

> If the host and port parameter is not provided, do we use `BallistaContext::standalone` mode? Yes, exactly.

[Python] Add support for `df.show()` on `CREATE EXTERNAL TABLE` statements

It actually does work but we get an error if we try and show the results of the DataFrame. This is not good UX so we will need to fix....

Clean up job data on both Scheduler and Executor

I am constantly filling my disk up with shuffle files so would love to see us get this merged before the 0.9.0 release. @mingmwang Could you rebase when you get...

Clean up job data on both Scheduler and Executor

@mingmwang could you fix the conflicts here when you have the time so that we can merge this?