private-llm-aws icon indicating copy to clipboard operation
private-llm-aws copied to clipboard

TF Deploy embedding model on SageMaker

Open wesdottoday opened this issue 2 years ago • 0 comments

  • [ ] TF takes the embedding model from S3 and makes it available as an endpoint in SageMaker
  • [ ] TF takes the instance type variable and uses that to decide what instance to deploy
  • [ ] Set the endpoint URI to a variable in TF
  • [ ] Documentation of the URI and how to use it

Terraform should take the user's input and deploy the Embedding model of choice to SageMaker.

wesdottoday avatar Sep 26 '23 19:09 wesdottoday