datafusion-ballista icon indicating copy to clipboard operation
datafusion-ballista copied to clipboard

Add REST endpoint to get DOT graph of a job

Open andygrove opened this issue 2 years ago • 4 comments

Which issue does this PR close?

N/A

Rationale for this change

This is essential to comprehending how Ballista is executing a query.

test

What changes are included in this PR?

New endpoint: http://localhost:50050/api/job/<job-id>/dot

Are there any user-facing changes?

andygrove avatar Sep 18 '22 22:09 andygrove

Very nice! What generates the png?

http://localhost:50050/jobs/<job-id>/dot serves up the raw dot file. I am converting to png locally. I would like the Web UI to just render this though.

andygrove avatar Sep 18 '22 23:09 andygrove

Very nice! What generates the png?

http://localhost:50050/jobs/<job-id>/dot serves up the raw dot file. I am converting to png locally. I would like the Web UI to just render this though.

I didn't think this was possible, but it looks like someone has transpiled graphviz to wasm so it runs in the browser now https://github.com/magjac/d3-graphviz.

avantgardnerio avatar Sep 18 '22 23:09 avantgardnerio

very nice graph

yahoNanJing avatar Sep 19 '22 06:09 yahoNanJing

@yahoNanJing @thinkharderdev @avantgardnerio This is now ready for review. I will follow up with smaller PRs to improve formatting and add metrics.

andygrove avatar Sep 24 '22 18:09 andygrove

LGTM

yahoNanJing avatar Sep 27 '22 14:09 yahoNanJing

Thanks for the review @Dandandan and @yahoNanJing

andygrove avatar Sep 27 '22 23:09 andygrove