docqai
INFRA: Cloud-vendor-hosted models
Is your feature request related to a problem? Please describe.
Current Docq only support Openai.com for demo/protoype. This is obviously not private.
Describe the solution you'd like So we want to drop that and support for cloud vendor serverless models, as below, that can be deployed in a customers' VPC.
- [x] Azure OpenAI #33
- [ ] AWS TitanML/Bedrock #32
- [ ] GCP PaLM #35
The app needs support added for each of these as the high level API (in LlamaIndex and LangChain are different).
Finally setting section needs to be adjusted to indicate which models are provisioned on the backend hence being used by the app code. Handled in #12
Describe alternatives you've considered
No alternative.
Additional context
Likely via LangChain or another similar library; Unlikely to do it manually by dropping down to the API level.
