modAL icon indicating copy to clipboard operation
modAL copied to clipboard

Use modAL on BERT models

Open XinY-Z opened this issue 2 years ago • 1 comments

Hi, I'm new to active learning and modAL. I want to fine-tune a RoBERTa model on a (yet) unannotated dataset with active learning. Has anyone tried applying modAL to huggingface models like RoBERTa or DeBERTa? I wonder if the two modules are ever compatible.

XinY-Z avatar Oct 02 '23 23:10 XinY-Z

You're gonna have to elaborate your use-case a bit. As long as your classifier has a .predict method you should be able to use it. You would need to measure with the evaluation metric that you decide to determine whether it is a success or not.

amirothman avatar Feb 11 '24 18:02 amirothman