How to extract probabilities of models like Roberta?

[franz101]

For most NER models I was able to extract the probabilities of the prediction (ConfidenceScores). I noticed Roberta and Albert are missing the setIncludeAllConfidenceScores function in johnsnowlabs > 5. Is there a way to still extract the ConfidenceScores maybe I missed it in the documentation.

How to reproduce:

import sparknlp
from johnsnowlabs.nlp import PretrainedPipeline

spark = sparknlp.start()

pipeline = PretrainedPipeline("albert_base_token_classifier_conll03_pipeline", lang = "en")

pipeline.model.setIncludeAllConfidenceScores(True)

[C-K-Loan]

@franz101 the method setIncludeAllConfidenceScores is not available on every annotator, in particular, the XYZ-For-Token-Classification based annotators do not support this feature yet. Any NerDL, MedicalNerDL, FinanceNerDL, LegalNerDL architecture based models currently support setIncludeAllConfidenceScores

I will talk with @maziyarpanahi to get it on the roadmap or find workarounds