[FEATURE]: Add IRS Metric

Open ema-marconato opened this issue 3 years ago • 2 comments

Hello, it would be nice to integrate also Interventional Robustness Score (IRS). https://arxiv.org/abs/1811.00007

Do you believe it is easy to integrate?

Bests

Oct 16 '22 06:10 ema-marconato

Hi there,

I can't be sure right now, would need to sit with the paper for a while and evaluate.

Do you know of any existing implementations that can be used as a reference? Also, is there any chance you would you be willing to contribute?

Oct 17 '22 12:10 nmichlo

Hi, yes you can find an implementation here: https://github.com/google-research/disentanglement_lib. I don't have time now to work on it, but there 3/4 interesting causal measures of disentanglement that are very useful. Let you know if I have time for that. Thank you for your work. Cheers,

Emanuele

Oct 26 '22 10:10 ema-marconato