GPTCache

GPTCache copied to clipboard

[Bug]: 'HuggingFaceBgeEmbeddings' object is not callable

2

### Current Behavior from langchain.embeddings import HuggingFaceBgeEmbeddings `model_name = "BAAI/bge-small-en" model_kwargs = {'device': 'cpu'} encode_kwargs = {'normalize_embeddings': False} hf = HuggingFaceBgeEmbeddings( model_name=model_name, model_kwargs=model_kwargs, encode_kwargs=encode_kwargs ) cache_base = CacheBase('sqlite') vector_base =...

aniketmoha9

[DOCS]: Add support for remote databases in GPTCache server config

1

### Documentation Link https://github.com/zilliztech/GPTCache/blob/main/examples/README.md#How-to-use-GPTCache-server ### Describe the problem My database service is running in another docker container, I tried to create a separate GPTCache server, but couldn't find the documentation....

echosun1996

[Feature]: Cache answer diversity

3

### Is your feature request related to a problem? Please describe. Currently, when GPTCache evaluates similarity, it retrieves cached answers that meet the similarity threshold. However, in many generation scenarios,...

SimFG

[Feature]: Find a more suitable similarity evaluation model

1

### Is your feature request related to a problem? Please describe. Currently, GPTCache achieves an accuracy of approximately 80% in optimal conditions. However, during daily usage, it often returns unsatisfactory...

SimFG

[Feature]: Multi-tenant GPTCache service

1

### Is your feature request related to a problem? Please describe. Currently, the GPTCache service uses a cache object to manage cached data. If GPTCache serves multiple users, user A's...

SimFG

[Feature]: Support correcting error cache

1

### Is your feature request related to a problem? Please describe. When a cache miss occurs, that is, the question does not match the cached answer, cache correction is supported....

SimFG

[Bug]: Error with AzureChatOpenAI using langchain - [ONNXRuntimeError] : 2 : INVALID_ARGUMENT : Got invalid dimensions for input: token_type_ids for the following indices index: 1 Got: 1772 Expected: 512 Please fix either the inputs or the model.

3

### Current Behavior I am getting this error when using AzureChatOpenAI from Langchain I tried implementing the GPT Similarity cache mentioned in the langchain page -https://python.langchain.com/docs/integrations/llms/llm_caching, but getting below error....

UmerQam

[Enhancement]: Option to set context in request in GPTCache Server

4

### What would you like to be added? I am using GPTCache Server and use `/put` and `/get` primarily . In my use case, there are multiple user utilizing this...

l0calh0st8080

[Bug]: gptcache seems does not support get-turbo-3.5-16k chat generation

4

### Current Behavior When I would like to use gptcache as langchan cache but found the below error message: ``` File "/Users/xxx/Library/Python/3.9/lib/python/site-packages/langchain/chains/base.py", line 361, in acall raise e File "/Users/xxx/Library/Python/3.9/lib/python/site-packages/langchain/chains/base.py",...

hueiyuan

[Enhancement]: Support langchain.schema.ChatGeneration

6

### Is your feature request related to a problem? Please describe. I'm using langchain and started a GPTCache integration, but after a few attempts I did manage to config everything...

Sendery