Portable workspace directory

[ento]

Motivation

Data files created by this framework are currently saved in multiple places, which are hardcoded:

./data
./downloaded_images
./pre_trained_weights

In particular, files needed for deployment are in ./data and ./pre_trained_weights.

This leaves these user stories unfulfilled:

• When I deploy a model to a remote location, I want a simple way to specify all the files I need, so that it's easily automated and future-proof.
• When I'm experimenting with multiple classification projects, I want to easily switch between projects, so that progress is saved and easy to pick up later.

Proposed changes

Provide a command that initializes a workspace directory with the expected directory structure.

workspace/
  downloaded_images/
  wip/
    data.hdf5
  dist/
    latest_model_weights.hdf5
    model_weights.hdf5
    categories.p

All of the entrypoint scripts should take a --workspace=dir argument and look for files within the workspace:

google_image_scraper.py
train.py
deploy.py
deepanimebot/bot.py
deepanimebot/webapp.py

[ento]

wip here: https://github.com/AntreasAntoniou/DeepClassificationBot/tree/workspacing