GPTCache icon indicating copy to clipboard operation
GPTCache copied to clipboard

[Feature]: please support google LLM

Open shixiao11 opened this issue 2 years ago • 2 comments

Is your feature request related to a problem? Please describe.

Hello team, My team was working on the Gen AI project and all the projects are base on the google cloud. So is it possible to make GPTCache integrated with google LLM(gemini or bisontext)

Describe the solution you'd like.

  • 1, support google LLM
    1. support google embedding function
  • 3, support pinecone as the vector database

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

shixiao11 avatar Jan 16 '24 07:01 shixiao11

+1

varunmehra5 avatar Jun 20 '24 15:06 varunmehra5

The number of large models is growing explosively, and I think it may not be meaningful to keep adding models. Maybe you can try to use the get and set API in gptcache, demo code: https://github.com/zilliztech/GPTCache/blob/main/examples/adapter/api.py

SimFG avatar Jun 21 '24 02:06 SimFG