example-repos-dev icon indicating copy to clipboard operation
example-repos-dev copied to clipboard

start: deploy model from registry

Open dberenbaum opened this issue 2 years ago • 0 comments

Report

We have the sagemaker example where we deploy, but we don't expose the endpoint nor provide a way for the user to try deployment themselves.

Some options to explore (we could also try to partner with whoever we choose here):

  • could start with just building a docker image and pushing it to dockerhub
  • https://github.com/replicate/cog with or without hosting on https://replicate.com/
  • flyio like in https://iterative.ai/blog/mlem-nanogpt-modal-flyio

dberenbaum avatar Oct 20 '23 17:10 dberenbaum