Task confusion matrix

[ashok-arjun]

Hi,

Similar to the class confusion matrix available, is there a task confusion matrix also available? This would be useful to actually assess BWT and other metrics, since every task's accuracy after every other task will be in the same table.

Thanks!

[AndreaCossu]

Hi @ashok-arjun , we do not currently have an implementation for the task confusion matrix, even if it is definitely possible to implement it. We will try our best to address the issue, feel free to contribute if you can :smile:

[vlomonaco]

@AndreaCossu let me know if we want to consider this as an actionable item or you prefer to have it in the "feature-request" list on discussions.