skdb icon indicating copy to clipboard operation
skdb copied to clipboard

Build insight UI

Open gregsexton opened this issue 1 year ago • 2 comments

This renders a debug trace given a static JSON file that is generated by SKStore.

gregsexton avatar Sep 25 '24 11:09 gregsexton

Carved out a PR for just the rendering while I continue working on the backend.

'Insight' is what I've been calling the debugger. It's more of a trace than a 'debugger', but in my experimentation this is much more useful - and it will work across machines, platforms, languages, etc.

I'll attach some screenshots.

gregsexton avatar Sep 25 '24 11:09 gregsexton

Here I ask for a trace of a key produced by a left outer join.

Screenshot 2024-09-25 at 12 10 22

You can zoom, pan around, adjust the positions of nodes, etc.

Screenshot 2024-09-25 at 12 10 38

As you hover over files, the upstream dependencies - including reads performed by the mapper - are highlighted.

Screenshot 2024-09-25 at 12 10 55

You can click in to the detail of how any file was produced. These are the collapsed sections.

Screenshot 2024-09-25 at 12 11 27

Here we see the logic for the computation, with the full transitive closure. Using this we can understand exactly how the logic operated and why it produced this value.

Screenshot 2024-09-25 at 12 13 11

Here are the out of band reads made compared to the input files the DAG fed the mapping function.

Screenshot 2024-09-25 at 12 14 12

gregsexton avatar Sep 25 '24 11:09 gregsexton