[Bug] support deleteMany for serverless option

[ladrians]

Is this a new bug?

• [X] I believe this is a new bug
• [X] I have searched the existing issues, and I could not find an existing issue for this bug

Current Behavior

I am trying to test the serverless option as we are using a bunch of indexes in our organization. For us is mandatory to delete or at least locate vectorIds by metadata. Are these limitations permanent? https://docs.pinecone.io/docs/limits#serverless-index-limitations

During ingestion we associate document information that then need to locate all chunks from there during a delete operation. Now we are using a filter like

...
  const filter = {
    id: identifier
  };
...
await namespace.deleteMany(filter);

Expected Behavior

Followed the comments from here but still cannot locate the vectors I need to delete. https://docs.pinecone.io/docs/manage-rag-documents#fetch-all-records-for-a-parent-document

Steps To Reproduce

create a serverless index, try to delete some vectors by some metadata

...
  const filter = {
    id: identifier
  };
...
await namespace.deleteMany(filter);

Relevant log output

No response

Environment

- **OS**: windows 10
- **Language version**: nodejs 18
- **Pinecone client version**: 2.0.0

Additional Context

Would like to know the timeframe for this support as without this option is not possible to evaluate the new serverless option. Besides would be nice to have a method on the namespace to be able to list documents, otherwise extrametadata is needed to do a POST as detailed here, we do not have the metadata to fully locate the index location

https://docs.pinecone.io/docs/manage-rag-documents#fetch-all-records-for-a-parent-document

In short for the library it would be grat to

• support the same options as non serverless for delete operations
• otherwise provide an option to get ids from metadata to then do the deletion manually. That again, could be wrapped in the library.

standing by, thanks in advance

[ladrians]

any comment on this issue? a little concerned to know this is on the roadmap on the serverless indexes.

[phgn0]

I'm getting this error when calling deleteMany with a metadata filter on a serverless index:

PineconeBadRequestError: Filters in this operation are not supported by the current index type 'Starter'.

I'm on the Standard account plan though:

[dsenese]

I am getting the same issue on the Standard Plan using serverless. I believe this was working last week however when I originally switched. Would very much appreciate an update on this.

[rafalzawadzki]

I suspect the error is just misleading - just means that filters are not supported in deleteMany operation, regardless of your plan

[ladrians]

any advance on this issue of deleting vectors by metadata for serverless?

[ladrians]

I have not followed this case, is there any advance to be able to delete vectors by metadata for serverless? Is it no the roadmap? Your feedback is important for us to analize options. thanks in advance

[anawishnoff]

This is currently a limitation of serverless, though it's on our roadmap to address. We'll circle back once this has been completed. Thanks!