lance icon indicating copy to clipboard operation
lance copied to clipboard

Support multiple columns (composite key) for `merge_insert`

Open westonpace opened this issue 1 year ago • 2 comments

Example scenario: A document is chunked into paragraphs and each paragraph is embedded and the row contains the document_id and the paragraph_id. Later, the user recalculates the embedding for one of the documents and wants to replace the rows.

westonpace avatar Nov 14 '24 19:11 westonpace

Adding merge_insert support isn't too bad. However, for performance reasons, we may also want to tackle #3125

westonpace avatar Nov 14 '24 19:11 westonpace

Looking at the code, this seems to work, but

  1. Isn't well tested
  2. Won't use any scalar indices

We can leave this issue open to implement those two.

wjones127 avatar Jan 30 '25 18:01 wjones127