openui icon indicating copy to clipboard operation
openui copied to clipboard

Can´t Use it with VERTEX AI

Open everaldo opened this issue 4 months ago • 0 comments

Got this error:

Image

Error! 400 Error code: 400 - {'error': {'message': 'litellm.BadRequestError: VertexAIException BadRequestError - vertexai import failed please run pip install -U google-cloud-aiplatform "anthropic[vertex]"\nReceived Model Group=claude-3-5-sonnet\nAvailable Model Group Fallbacks=None', 'type': None, 'param': None, 'code': '400'}}

My litellm-config.yaml

model_list:
  - model_name: claude-3-5-sonnet
    litellm_params:
      model: vertex_ai/claude-3-5-sonnet@20240620
      vertex_ai_project: os.environ/VERTEXAI_PROJECT
      vertex_ai_location: os.environ/VERTEXAI_LOCATION

I´ve also tried this:

 docker run --name openui-test -p 7878:7878   -e VERTEXAI_PROJECT   -e VERTEXAI_LOCATION   -e GOOGLE_APPLICATION_CREDENTIALS   -v $(pwd)/openui_data/litellm-config.yaml:/app/litellm-config.yaml -v $(pwd)/openui_data/application_default_credentials.json:/app/application_default_credentials.json   --entrypoint /bin/bash   ghcr.io/wandb/openui -c "pip install -U google-cloud-aiplatform 'anthropic[vertex]' && python -m openui --litellm"

But it fails.

everaldo avatar Oct 07 '24 03:10 everaldo