dspy icon indicating copy to clipboard operation
dspy copied to clipboard

Published 20 hours ago • verified publisher icon stanfordnlp

feature(dspy): Added support for Google Cloud Vertex AI

Open amithmathew opened this issue 5 months ago • 4 comments

Added support for Google Cloud Vertex AI.

This includes -

  • Support for specifying GCP project, location and region during init.
  • Support for passing custom credentials - passed through to vertexai.init
  • Restrict candidate_count to 1 for Gemini model, otherwise set to 4 (Bison model supports 4)
  • Updates to make sure inspect_history works as expected.

amithmathew avatar Mar 20 '24 03:03 amithmathew

The discussion about Vertex AI is ongoing here. Could you also refer to this PR?

nbqu avatar Mar 20 '24 06:03 nbqu

Thanks @nbqu - the link you've provided links to this PR itself. Is there another one?

amithmathew avatar Mar 20 '24 14:03 amithmathew

oops, there was a typo on the link! #616 covers vertex AI. Can you check it too?

nbqu avatar Mar 20 '24 16:03 nbqu

@amithmathew Does the merged #616 cover this?

arnavsinghvi11 avatar Apr 08 '24 17:04 arnavsinghvi11