deepforge icon indicating copy to clipboard operation
deepforge copied to clipboard

Add support for opening artifacts with interactive explorers

Open brollb opened this issue 4 years ago • 3 comments

Artifacts should be able to be opened with interactive explorers/artifact explorers (the label for these is named after the latter though they should be synonymous). At a high level, the idea is that artifacts should be able to explored using some interactive UI. This UI should request an interactive compute instance and then can load arbitrary other artifacts into it, etc. When the data is saved, it is saved within the given artifact. One example of the motivation for loading arbitrary artifacts into it is evaluating a neural network; the generated metadata should be associated with the network but the test data needs to be loaded to generate the accuracy/loss metrics.

This needs to be fleshed out a little more especially around the interplay between viewing existing metadata and opening an interactive explorer. It shouldn't be too hard to resolve but still needs to be resolved before this is addressed!

brollb avatar Jul 28 '20 17:07 brollb

Unfortunately, this means that the TensorPlotter is not currently available without patching the source code for the ArtifactIndexWidget.

brollb avatar Jul 28 '20 17:07 brollb

As discussed before, this would mean that when there's a whole host of Interactive explorers, they should be able to access a project's artifact. Alternatively, couldn't artifacts could directly loaded (from the explorers) ?

umesh-timalsina avatar Jul 28 '20 17:07 umesh-timalsina

I have been trying to make a distinction between explorers and editors where an explorer generates some metadata node saved within an artifact and an editor saves an artifact in the artifacts index (discussed in more detail here).

Each should have their own way to access them; explorers would make sense to access by opening the artifact to explore and then having something like a prompt for which explorer to use. Editors, on the other hand, would make sense to have as a new concept in the sidebar on the left.

brollb avatar Jul 28 '20 17:07 brollb