zenml icon indicating copy to clipboard operation
zenml copied to clipboard

Argilla annotator

Open strickvl opened this issue 2 months ago • 3 comments

Added the third and final (for me, for now 😄) annotator integration (alongside https://github.com/zenml-io/zenml/pull/2655 and https://github.com/zenml-io/zenml/pull/2641), this time for Argilla.

argilla_annotator

This works both locally-deployed and when the annotation instance lives in the cloud (i.e. in the Hugging Face Spaces deployment which they recommend).

I tried including some of the changes that have been made in the other two PRs, but depending on the merge order there might need to be some final tweaks. (Also, there probably can be some final updates to the BaseAnnotator interface at a later date now that I have a far stronger sense of what's needed and what's not (which we didn't have when we first implemented just Label Studio)).

The Argilla team have mentioned that their SDK / interface will be updated to a 2.x version where lots of things will be fixed, at which point we can update this to fit it.

Relates to https://github.com/argilla-io/argilla/issues/4277 and https://github.com/zenml-io/zenml/issues/2579

To do

  • [x] make a note about breaking change to interface
  • [x] ~~Adding datasets should use ‘FeedbackDataset’ as the interface or offer different types~~

strickvl avatar May 09 '24 20:05 strickvl