DeepPavlov icon indicating copy to clipboard operation
DeepPavlov copied to clipboard

Define a way to improve NER installation through adding new cases and retraining it

Open danielkornev opened this issue 5 years ago • 2 comments
trafficstars

Want to contribute to DeepPavlov? Please read the contributing guideline first.

What problem are we trying to solve?:

In production systems, it is important to have a simple and non-obtrusive way to extend capabilities on NER to recognize new objects or fix recognition of the existing ones

How can we solve it?:

Web interface for adding new cases

Are there other issues that block this solution?:


danielkornev avatar Aug 27 '20 13:08 danielkornev

I suppose a good NER Service should cover the following use cases:

  1. Annotate requests with NER entites (as any NER tool must do) via REST API
  2. Allow Admins to view log of requests for annotation and produced results
  3. Allow Admins to add new training cases into the dataset (which will fine-tune NER model instantly or via button).

It seems to be a quite simple web app.

acriptis avatar Sep 02 '20 15:09 acriptis

I agree. The 3rd point seems to be interesting. But, we cant expect the model to fine-tune in real-time. Do you mean to transfer learning? Transfer the weights of the new data to the existing trained model?

Rajmehta123 avatar Nov 13 '20 22:11 Rajmehta123