ParameterImportance icon indicating copy to clipboard operation
ParameterImportance copied to clipboard

Fix many NaNs in conditional parameter-spaces

Open shukon opened this issue 4 years ago • 2 comments

When using conditionals, there might be nan-values... rendering the importance of an entire parameter useless. On the other hand, this solution might consider some parameters more than others by reducing the considered values? I am not sure how to handle this, @AndreBiedenkapp

shukon avatar May 09 '20 18:05 shukon

I thought the way the neighbors are sampled only allows for valid configurations in LPI. Has something changed in the config space or am I simply mistaken?

But to give you an idea of how conditionals are handled in the other methods. In ablation we handle conditionals by jointly flipping them with their parent parameter. And then we attribute the importance to that tuple and not one individual parameter. AFAIK fANOVA ignores conditionals entirely and pretends they are just normal parameters.

AndreBiedenkapp avatar May 10 '20 07:05 AndreBiedenkapp

Well, the NaN's might have a different reason. I will investigate further...

shukon avatar May 10 '20 09:05 shukon