deepvats icon indicating copy to clipboard operation
deepvats copied to clipboard

Upload new datasets from the app

Open vrodriguezf opened this issue 4 years ago • 3 comments
trafficstars

Things to consider:

  • The app should call the notebook 01_create_artifact to register the user dataset in wandb. This can be done with papermill
  • Since the app is going to get bigger, having everything in just two files (server.R and ui.R) is not going to scale well. Instead, we should use shiny modules. See more here
  • We can use a shiny navbar element for this module, or a shinydashboard tab if we move to shinydashboard.
  • For now we can assume that the data comes as a table (rows=timesteps, columns=variables) in a csv-like file, and that timesteps are evenly spaced.
  • It would be very handy to show the data with the same widget that is used in the embeddings projector, in order to select the intervals for training/validation/test
  • Explore the "import dataset" Rstudio button and see if it can be called from code

vrodriguezf avatar Sep 24 '21 09:09 vrodriguezf

https://projector.tensorflow.org/

vrodriguezf avatar Sep 24 '21 15:09 vrodriguezf

It sould be handy to have an option here to have the validation set = train set. This can be useful in cases in which the tool wants to be used to analyse the whole dataset at hand, without predictive or future purposes.

vrodriguezf avatar Oct 27 '21 08:10 vrodriguezf

Have a look to https://dreamrs.github.io/datamods

There are modules to import and validate dataset in shiny easily

vrodriguezf avatar Nov 28 '21 15:11 vrodriguezf