promptflow icon indicating copy to clipboard operation
promptflow copied to clipboard

Support changing LLM tool Deployment name via environment variables for better parameterisation

Open graemefoster opened this issue 1 year ago • 1 comments

I want to build a Prompt Flow into a docker container and re-use it in different environments. But for organisational reasons the deployment-names on my Azure Open AI deployments are not the same. Currently in Prompt flow, the deployment-name is not part of an Azure Open AI connection (where it could be overridden)

Describe the solution you'd like I'd like to be able to change the deployment-name based on an environment variable. So, in the yaml, something like:

inputs: deployment_name: ${environment.some_variable}

Describe alternatives you've considered Custom tools, but I'd like to use the built-in tools. Providing deployment name as a parameter... I don't want the user to be able to set this. It should be contextual to the deployment.

Additional context I've had a good look through the documentation. This file suggests it might be possible, but no example is given that changes the deployment-name: https://microsoft.github.io/promptflow/tutorials/run-management.html - "Sometime you want to switch connection or deployment name inside a flow when submitting it". The example only shows changing a connection. The deployment name is not part of the connection object.

graemefoster avatar Sep 03 '24 08:09 graemefoster

Hi, we're sending this friendly reminder because we haven't heard back from you in 30 days. We need more information about this issue to help address it. Please be sure to give us your input. If we don't hear back from you within 7 days of this comment, the issue will be automatically closed. Thank you!

github-actions[bot] avatar Oct 03 '24 21:10 github-actions[bot]