cloud icon indicating copy to clipboard operation
cloud copied to clipboard

Re-use images (only changing parameters)?

Open tc-wolf opened this issue 4 years ago • 2 comments

My current workflow is to use the gcloud CLI to submit jobs with a common base image and differ the parameters (used in a CI setting). I like that in tensorflow cloud that the machine types and accelerator types are expressible as code, but I don't want to rebuild the image (and re-upload) the image each time I train.

Is there anyway to re-use the same image (but just supply a different 'trainer' file)? What I'd like to do is to push the trainer file + hyper parameters (as YAML or JSON) and keep the image the same across runs (except when my dependencies change).

I see that you can specify a custom base image, but AFAICT a new image would still be built / pushed.

tc-wolf avatar Jul 10 '20 19:07 tc-wolf

Thank you for the issue @tc-wolf . This is a great question and I see that this is a very useful and important feature to have. Let me look into adding support for this.

pavithrasv avatar Jul 16 '20 20:07 pavithrasv

Thank you for looking into this :)

tc-wolf avatar Jul 17 '20 18:07 tc-wolf