kernel-memory icon indicating copy to clipboard operation
kernel-memory copied to clipboard

[Feature Request] ReRun Document processing

Open KSemenenko opened this issue 5 months ago • 4 comments

Context / Scenario

I process 500 page pdf, and somwere in the middle of process I reach TooManyRequset for Azure OpenAI. and import is failed.

But I need a way to continue it. maybe halp of parts is already embedded, so I want to continue.

The problem

Now I can't process document, and I can't conintue from places/step I stopped.

Proposed solution

Option to conintue / rerun document processing. so I can do like this:

var info = await memory.GetDocumentStatusAsync(fileInfo.DocumentId, "default");
if (info.Completed == info.Failed == false)
{
    var result = await memory.ImportDocumentAsync(new Document(info.DocumentId),  "default", info.RemainingSteps);
}

but i don't think it's good idea.

Importance

would be great to have

KSemenenko avatar Jan 25 '24 22:01 KSemenenko