label-studio-ml-backend icon indicating copy to clipboard operation
label-studio-ml-backend copied to clipboard

"Use for interactive pre annotations" does not work properly

Open ilBonez opened this issue 2 years ago • 2 comments

Problem

After linking a Question Answering model and activating the "Use for interactive preannotations" button, I expect that when I click on a task, it will run the predictions of the questions that I specified in my label_studio_backend python file. This process happens but in the following way:

  1. click on the task where to make the annotations
  2. from the label studio backend log I see the predictions of the model
  3. the task is loaded without the predictions
  4. exit from task
  5. enter on the same task and the predictions appear correctly (the query to the model is not re-executed from the log)

I believe that exiting and reentering the task is not the correct procedure to view the predictions of the model.

The same problem occurs performing the prediction of a single Question (I exclude problems relative to multiple predictions of many Questions).

Screenshots

image

Environment

I ran the test in local environment (no docker) with the following versions:

  • Windows 11
  • Python 3.9.13
  • label-studio 1.7.3
  • label-studio-ml 1.0.8rc3
  • label-studio-converter 0.0.51
  • label-studio-tools 0.0.2

ilBonez avatar May 22 '23 13:05 ilBonez

Hello, I add an additional point to this issue: I get the same behaviour for an "Object detection with bounding box" task. Fixing this problem would be very helpful!

ftesser avatar May 22 '23 14:05 ftesser

I am experience the same issue with a semantic segmentation model.

KevinMenden avatar Jul 11 '23 08:07 KevinMenden