mem0 icon indicating copy to clipboard operation
mem0 copied to clipboard

LanceDB Integration

Open PrashantDixit0 opened this issue 1 year ago • 1 comments

Description

This PR adds LanceDB vector database.

Type of change

  • [x] New feature (non-breaking change which adds functionality)

How Has This Been Tested?

I have written tests for the LanceDB vector database in tests/vectordb/test_lancedb.py

  • [x] Test Script (please provide)

Checklist:

  • [x] My code follows the style guidelines of this project
  • [x] I have performed a self-review of my code
  • [x] New and existing unit tests pass locally with my changes
  • [x] I have checked my code and corrected any misspellings

Maintainer Checklist

  • [ ] closes #xxxx (Replace xxxx with the GitHub issue number)
  • [ ] Made sure Checks passed

PrashantDixit0 avatar Mar 16 '24 04:03 PrashantDixit0

hey guys can we let this reviewed? Thanks!

AyushExel avatar Mar 27 '24 15:03 AyushExel

@PrashantDixit0 thanks for proposing these changes. I had a look at your code. There are 2 minor problems with the imports. embedchain/config/vectordb/lancedb.py: please correct the import line to from embedchain.helpers.json_serializable import register_deserializable

tests/vectordb/test_lancedb.py: please correct import line to:

from embedchain.config import AppConfig
from embedchain.config.vectordb.lancedb import LanceDBConfig

Further, lancedb is not yet added to the factory.py and the misc.py. Can you add this?

LeonieFreisinger avatar May 17 '24 08:05 LeonieFreisinger

@LeonieFreisinger Thank you for highlighting it, I have added these changes. Is it now good to merge?

PrashantDixit0 avatar May 17 '24 09:05 PrashantDixit0

@PrashantDixit0 What example did you use to test your code? Can you provide me with a quick example and a sample config? Thanks. Could you also add an example to the docs?

LeonieFreisinger avatar May 17 '24 09:05 LeonieFreisinger

Sure @LeonieFreisinger, I'll add an example notebook in notebooks folder

PrashantDixit0 avatar May 17 '24 09:05 PrashantDixit0

@LeonieFreisinger, I have added an example notebook and tested the whole flow. Is it good to merge?

PrashantDixit0 avatar May 18 '24 22:05 PrashantDixit0

@deshraj Can you start reviewing it?

PrashantDixit0 avatar Jun 03 '24 07:06 PrashantDixit0

Hi @PrashantDixit0 Can you please resolve the conflicts?

Dev-Khant avatar Jun 11 '24 07:06 Dev-Khant

Sure

PrashantDixit0 avatar Jun 11 '24 07:06 PrashantDixit0