LightRAG icon indicating copy to clipboard operation
LightRAG copied to clipboard

[Feature Request]: Instead of using Docling library in the solution use Docling-serve to offload document processing

Open acsangamnerkar opened this issue 8 months ago • 2 comments

Do you need to file a feature request?

  • [ ] I have searched the existing feature request and this feature request is not already filed.
  • [ ] I believe this is a legitimate feature request, not just a question or bug.

Feature Request Description

As of not the document ingestion option of Docling is using the python library. It does increase the time to build and run the solution. Also, the initialization with the first document takes a long time.

My proposal will be to use the default option as it is but use the docling-serve as a container and add the URL of the docling server as a ENV config.

https://github.com/docling-project/docling-serve?tab=readme-ov-file

This will also give you an option of running the docling API on CPU or GPU as per requireemnt.

Additional Context

No response

acsangamnerkar avatar Apr 25 '25 00:04 acsangamnerkar

Thanks for you suggestion.

danielaskdd avatar Apr 26 '25 00:04 danielaskdd

This is a very good feature request! was deciding to use docling service on a separate server in conjuction with Lightrag.

BireleyX avatar May 08 '25 09:05 BireleyX