AutoGPT icon indicating copy to clipboard operation
AutoGPT copied to clipboard

Pinecone alternatives

Open EnricoBeltramo opened this issue 1 year ago • 1 comments

Duplicates

  • [X] I have searched the existing issues

Summary 💡

Pinecones has often unexpected shutdown and some limits if you use free accounts. Is it possible to implement alternative vector database to connect i.e. ElasticSearch that offer a docker to run it locally?

Examples 🌈

No response

Motivation 🔦

  • to have alternatives when Pinecone has issue /limitations
  • To keep locally an instance of my database and data

EnricoBeltramo avatar Apr 15 '23 13:04 EnricoBeltramo

They have recently added support for Redis, Milvus, and it looks like they are about to release support for Weaviate as well.

isaaclepes avatar Apr 15 '23 17:04 isaaclepes

Thank you for help! I didn't understand that Redis or Milvus can replace Pinecone.

EnricoBeltramo avatar Apr 15 '23 22:04 EnricoBeltramo

we can just replace Pinecode line in the .env file with Milvus?

joe-bera avatar Apr 20 '23 06:04 joe-bera

If you mean setting "MEMORY_BACKEND=milvus", then yes. there is a section in the .env.template for configuring the other memory backends, like Milvus.

image

isaaclepes avatar Apr 20 '23 14:04 isaaclepes

Here I created a wrapper on Open Search which includes all the features in Pinecone and yes, you can run it locally. https://pypi.org/project/opencone/ https://github.com/mjdileep/Opencone

mjdileep avatar Jul 30 '23 16:07 mjdileep