BentoML icon indicating copy to clipboard operation
BentoML copied to clipboard

feature: add progress to task API

Open smidm opened this issue 4 months ago • 2 comments

Feature request

It would be great when a long running task using the task API would be able to report on progress, e.g. as float between 0 and 1 or as a general string.

Motivation

An user feedback displayed in a CLI client or web frontend for long running tasks would be very helpful.

Other

No response

smidm avatar Aug 21 '25 15:08 smidm

Is it possible I can take this? Looking for beginner tasks!

manasadepu avatar Aug 22 '25 01:08 manasadepu

The problem here is that there are actually two backends for tasks: in-memory background task with sqlite result store and cloud-based ingress routing, only the former is built into the Bentoml project.

While it is easy to implement progress in the Bentoml project, that will bring behavior mismatch between the local and cloud backends. So let me discuss with the team first about how to move this on.

frostming avatar Aug 22 '25 01:08 frostming