OpenHands icon indicating copy to clipboard operation
OpenHands copied to clipboard

Gemini is not in the list of models

Open YasarAbi opened this issue 1 year ago • 14 comments

image

YasarAbi avatar Apr 02 '24 16:04 YasarAbi

OpenDevin Çalışma Alanı Dizini ./work

Modeli gpt-4

Ajan PlannerAgent

timucindusunur avatar Apr 02 '24 16:04 timucindusunur

config.toml

LLM_API_KEY="..." LLM_MODEL="gemini/gemini-pro" WORKSPACE_DIR="./work"

timucindusunur avatar Apr 02 '24 16:04 timucindusunur

bende çalişti.

timucindusunur avatar Apr 02 '24 16:04 timucindusunur

Confirmed this is a problem. Shouldn't be the case: https://docs.litellm.ai/docs/providers/gemini

Looks like we're not getting the right list of providers from LiteLLM

rbren avatar Apr 02 '24 21:04 rbren

I'll take a shot at this.

foragerr avatar Apr 02 '24 21:04 foragerr

Confirmed this is a problem. Shouldn't be the case: https://docs.litellm.ai/docs/providers/gemini

Looks like we're not getting the right list of providers from LiteLLM

Ask OpenDevin. It should fix it :)

YasarAbi avatar Apr 02 '24 22:04 YasarAbi

let me know @foragerr if you get a branch up on this, i'm interested for this purpose - got gemini pro 1.5 api working with the 1M tokens, excited to light up open-devin and add custom whisper speech to text feature so we are just talk to my agents

maestrocoder avatar Apr 02 '24 23:04 maestrocoder

Seems to be an issue with litellm. Raised a PR in their repo.

https://github.com/BerriAI/litellm/issues/2803 https://github.com/BerriAI/litellm/pull/2806

foragerr avatar Apr 03 '24 00:04 foragerr

any updates on this? i would also like to try gemini

azmodeuz avatar Apr 03 '24 09:04 azmodeuz

The new update broke it its not working. Gemini Pro! Also, there are 1500 options, but no Gemini, which is interesting.

timucindusunur avatar Apr 03 '24 12:04 timucindusunur

Upstream PR is now merged. If you use litellm==v1.34.22, you will see gemini in the drop down box.

https://github.com/BerriAI/litellm/releases/tag/v1.34.22

foragerr avatar Apr 03 '24 13:04 foragerr

The latest code can already see gemini, https://github.com/OpenDevin/OpenDevin/pull/641 accidentally fixed the problem LOL.

image

xcodebuild avatar Apr 03 '24 13:04 xcodebuild

https://github.com/OpenDevin/OpenDevin/pull/641 accidentally fixed the problem LOL.

No it didn't. This did: https://github.com/BerriAI/litellm/pull/2806

foragerr avatar Apr 03 '24 14:04 foragerr

See my comments in #653 about Gemini issues today.

jpshackelford avatar Apr 03 '24 20:04 jpshackelford

Sounds like this one is fixed!

rbren avatar Apr 04 '24 03:04 rbren