lucid icon indicating copy to clipboard operation
lucid copied to clipboard

Channels

Open ludwigschubert opened this issue 5 years ago • 3 comments

Allow image params to use an arbitrary amount of channels, then ensure that image_shape uses that correctly.

ludwigschubert avatar May 21 '19 00:05 ludwigschubert

I am going to give this a try. If you know of some critical places to begin with or some general information it would of great help :D

BadrYoubiIdrissi avatar Jun 04 '19 15:06 BadrYoubiIdrissi

@BadrYoubiIdrissi thank so much for your willingness! I imagine extending the parameterization itself (start at lucid.optvis.params.images) will be pretty straightforward, I'm more concerned about e.g. lucid.optvis.objectives operating on such a parameterization. LMK if you run into a situation where there's no clearly correct answer, or I can help with anything else!

ludwigschubert avatar Jun 04 '19 17:06 ludwigschubert

@ludwigschubert The decorrelation matrix seems to be infered from Imagenet, do you think I should provide a way for the user to specify a decorrelation matrix if the number of channels is different from 3?

I've looked into lucid.optvis.objectives and nothing stood out to me as being dependent on a change of the number of channels used in the parametrization, I might be missing something. (Except of course blur_alpha_each_step but that is normally only going to be used in the case of 4 RGBa channels)

BadrYoubiIdrissi avatar Jun 06 '19 15:06 BadrYoubiIdrissi