spyglass icon indicating copy to clipboard operation
spyglass copied to clipboard

Recompute method in computed tables

Open lfrank opened this issue 10 months ago • 3 comments

One of our main goals is to be able to share complete pipelines with results. Sharing of the various intermediate computed data outputs is one way to do this, but for data that can be computed relatively quickly, we could also enable remote users to recompute on the fly.

One possible solution would be to add a recompute method to each dj.Computed table that would regenerate the NWB file (using the same name) if it was not present locally. This would be quite a lot of work, and would also require a lot of thought as to what to do when upstream computed results are not available, but if we could get this to work we could share a much smaller subet of results when we publish papers, which would likely help.

lfrank avatar Apr 05 '24 17:04 lfrank