`PromptRunner` does not support `AzureChatOpenAI` as an LLM input

[tonydoesathing]

Awesome project! Was playing around with the tool and hit a wall, since I only have access to Azure's OpenAI...

Describe the bug PromptRunner does not support AzureChatOpenAI as an LLM input

Browser and Version

• chrome
• Version 124.0.6367.78 (Official Build) (64-bit)

To Reproduce Steps to reproduce the behavior:

1. Go to 'New Project'
2. Under LLMs, drag out a new AzureChatOpenAI
3. Fill in the data required for the LLM
4. Under Chains, drag out a new PromptRunner chain
5. Try to connect the BaseLanguageModel output of the AzureChatOpenAI block to the LLM input on the PromptRunner block and struggle

Expected Behavior I should be able to connect AzureChatOpenAI's output to the LLM input on any block

[dosubot[bot]]

To address the issue of connecting the BaseLanguageModel output of the AzureChatOpenAI block to the LLM input on the PromptRunner block, follow these steps:

1. Check Configuration Parameters: Ensure the configuration for AzureChatOpenAIComponent is correct, including model, azure_endpoint, azure_deployment, api_version, api_key, temperature, and max_tokens. The api_version should match the supported versions, like "2023-12-01-preview".

2. Error Handling: If there's a ValueError, it might be due to incorrect parameters or network issues when connecting to Azure OpenAI API. This indicates a problem in the instantiation process of AzureChatOpenAI.

3. Compatibility Check: Make sure the PromptRunner block is compatible with the latest AzureChatOpenAI class. The AzureChatOpenAI class is designed to work with PromptRunner blocks that accept BaseLanguageModel objects, but compatibility issues can arise with updates.

4. Update Dependencies: Ensure all dependencies, including langchain, langflow, and Azure SDKs, are current. Outdated dependencies can lead to compatibility problems.

5. Browser Compatibility: Test the setup in another browser or incognito mode to rule out browser-specific issues.

6. Review Documentation: The documentation for AzureChatOpenAIComponent might offer additional troubleshooting steps or insights.

If these steps don't resolve the issue, providing the exact error message or behavior observed when attempting the connection could help with further troubleshooting.

Details

Sources

• src/backend/base/langflow/components/model_specs/AzureChatOpenAISpecs.py
• src/backend/base/langflow/components/models/AzureOpenAIModel.py
• src/backend/langflow/components/llms/AzureChatOpenAI.py
• src/backend/langflow/components/chains/PromptRunner.py

About Dosu This response is meant to be useful and save you time. It is not meant to be a precise solution, but rather a starting point for your own research.

Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant.

To continue the conversation, mention @dosu.

[anovazzi1]

Hello @tonydoesathing, Sorry for the delay. Did you try using the new version? Does the error still persist?

[carlosrcoelho]

Hi @tonydoesathing

We hope you're doing well. Just a friendly reminder that if we do not hear back from you within the next 3 days, we will close this issue. If you need more time or further assistance, please let us know.


Thank you for your understanding!

[tonydoesathing]

Sorry, can I get an extension? It's on my todo list for tomorrow! I need to get everything set up again to test

[carlosrcoelho]

Hi @tonydoesathing,

No worries at all, we totally understand! Take your time to get everything set up and test. We'll keep the issue open and look forward to your update.

Thanks for letting us know!

[tonydoesathing]

Thanks! You're the best! ^-^ Running the latest, looks like AzureOpenAI now has an LLM output exposed which connects to things 👌