private-llm-aws
private-llm-aws copied to clipboard
singlestore-labs
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.0.313 to 0.0.329. Release notes Sourced from langchain's releases. v0.0.329 What's Changed Add Runnable.with_listeners() by @nfcampos in langchain-ai/langchain#12549 Improve Runnable type inference for input_schemas by @nfcampos in...
![dependabot[bot] avatar](https://avatars.githubusercontent.com/in/29110?v=4 "dependabot[bot] avatar"){kind=avatar}
SageMaker deploys EFS volumes and some security groups in the VPC that cause it to block the destroy process. I think better handling of dependencies in the Terraform plan will...
- [ ] Clone Kai Shoes repo, build container, push to ECR - [ ] Container URI in TF Variable - [ ] Create AppRunner deployment using ECR with ENV...
- [ ] Deploy SingleStoreDB based on config details asked of the user, Kai compatible - [ ] Store connection URL and creds in TF variable - [ ] Documentation...
- [ ] Take ECR URI and create an AppRunner service with appropriate environment variables - [ ] Store AppRunner URI in TF Variable - [ ] Store FastAPI API...
- [ ] Terraform should clone the FastAPI repo - [ ] Build the container - [ ] Push container to ECR in the appropriate region - [ ] Store...
- [ ] TF takes the LLM model from S3 and makes it available as an endpoint in SageMaker - [ ] TF takes the instance type variable and uses...
- [ ] TF takes the embedding model from S3 and makes it available as an endpoint in SageMaker - [ ] TF takes the instance type variable and uses...
- [ ] Look through existing models from SageMaker Jumpstart and select 2-3 embedding and text generation models - [ ] TF read Environment Variable (or in the TF code)...