chatgpt-retrieval-plugin icon indicating copy to clipboard operation
chatgpt-retrieval-plugin copied to clipboard

[Feature] datastore support for Cassandra

Open phact opened this issue 1 year ago • 8 comments

Hello Folks,

Thanks for creating and maintaining this great project. I'm excited to submit this PR to add datastore support for Apache Cassandra

The code includes:

  • upserting embedings and metadata into a cassandra table indexed with SAI (the embedding uses the brand new c* vector<float, n> type and index)
  • querying by cosine similarity and metadata (including score using cql similarity function)
  • point deletes and truncate
  • readme / docs
  • unit tests
  • support for secure connect bundle for AstraDB

I will be actively maintaining this on behalf of DataStax

phact avatar Jun 06 '23 01:06 phact

@alexleventer @msmygit I think all your comments are resolved. Thanks for the reviews!

phact avatar Jun 07 '23 15:06 phact

@isafulf would you mind having a look and helping us get this merged?

Thanks in advanced! Please let me know if I'm pinging the wrong person.

phact avatar Jun 26 '23 19:06 phact

@isafulf @luquitared we're hoping for a review. Thanks again!

phact avatar Jul 12 '23 04:07 phact

Hi @isafulf, could you please review?

phact avatar Jul 30 '23 06:07 phact

👋 although this is going into Cassandra it’s not yet released. So this is really about supporting vector search in AstraDB which is released and being used in production. I’d appreciate it if this PR can be reviewed by a CodeOwner. Let me know if there’s any way I can help!

tjake avatar Jul 30 '23 16:07 tjake

Merged conflicts introduced in https://github.com/openai/chatgpt-retrieval-plugin/commit/e8fda700edd6f5bc5e6e4f57b7aa163a8adb11be

phact avatar Jul 31 '23 14:07 phact

@isafulf checking in once more

phact avatar Aug 18 '23 01:08 phact

@isafulf could you take a look at this PR which is pending merge for sometime now? This is now used by many enterprises already and having this would be handy. Thank you in advance!

msmygit avatar Oct 25 '23 21:10 msmygit