langflow icon indicating copy to clipboard operation
langflow copied to clipboard

Published 20 hours ago • verified publisher icon langflow-ai

Integrating VertexAI / Google LLMs

Open mamigot opened this issue 1 year ago • 8 comments

Should integrate the VertexAI / Google Cloud Platform LLMs (already on LangChain) such as:

https://github.com/hwchase17/langchain/blob/master/langchain/llms/vertexai.py#L72

mamigot avatar May 31 '23 16:05 mamigot

https://github.com/logspace-ai/langflow/issues/419 will be relevant as well in order to close this issue

mamigot avatar Jun 01 '23 01:06 mamigot

I'll see if I can get my hands on it. I'm having trouble getting LangChain to recognize the credentials.

ogabrielluiz avatar Jun 01 '23 04:06 ogabrielluiz

Sounds good, and the credentials for which part? Happy to help

mamigot avatar Jun 02 '23 14:06 mamigot

I added the node, but running the gcloud set project ... didn't make the langchain class recognize the credentials for some reason.

ogabrielluiz avatar Jun 02 '23 17:06 ogabrielluiz

I added the node, but running the gcloud set project ... didn't make the langchain class recognize the credentials for some reason.

I have noticed some issues with the langchain integration picking up ADC (specifically the default Project ID) which seem to be resolved by running aiplatform.init(project=PROJECT_ID_HERE). Maybe try that?

TMRolle avatar Jun 05 '23 20:06 TMRolle

wondering if/when we maybe able to expect any progress here in using GCP VertexAI LLM models and services within LangFlow, like we already can in LangChain?

cachatj avatar Jun 27 '23 19:06 cachatj

I'm happy to assist from the Google side. I'm a backend troll and can't typescript to save my life, but I'm very familiar with our API platform/auth/etc and the python client libraries side of things. @ogabrielluiz or anyone else familiar with the frontend/langflow codebase side of the house, let me know if you want to set up a pair troubleshooting session to get that auth issue knocked out real quick (or just direct me to the relevant code, whatever's easiest)

TMRolle avatar Jun 27 '23 19:06 TMRolle

Hey @TMRolle. I've created a PR (#555) and added the Component to it. You should be able to drop it in the canvas and (try to) run it.

Should I set up a function to run google.auth before instantiating it?

ogabrielluiz avatar Jun 27 '23 19:06 ogabrielluiz

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

stale[bot] avatar Aug 13 '23 14:08 stale[bot]