(EAI-463): Move core ingest to `mongodb-rag-core`

[mongodben]

Jira: https://jira.mongodb.org/browse/EAI-463

Changes

Notes

[velias]

Is this PR going to solve problem with mongodb-rag-ingest package using very old langchain: ^0.1.16 dependency instead of newer @langchain/xzy used in mongodb-rag-core?

[mongodben]

Is this PR going to solve problem with mongodb-rag-ingest package using very old langchain: ^0.1.16 dependency instead of newer @langchain/xzy used in mongodb-rag-core?

hi @velias, thanks for your comment. i think this PR would resolve that issue.

however, could you submit a separate GH issue for upgrading langchain in mongodb-rag-ingest?

not sure when this PR will get merged, but we can certainly prioritize upgrading langchain in mongodb-rag-ingest

[mongodben]

closed b/c this work done in #548