data-efficient-gans icon indicating copy to clipboard operation
data-efficient-gans copied to clipboard

Why isn't DiffAugment used as a layer in the discriminator?

Open naddeoa opened this issue 11 months ago • 0 comments

I'm playing around with gans and trying to get this toy pokemon generator making plausible pokemon. One of the tools I've picked up is DiffAugment. Based on the original paper and examples, it looks like its typically used as a function over the input to the discriminator.

It seems like an obvious convenience to me to include it directly in the discriminator's model as an early layer that respects the Trainable parameter (like this) but I can't find anyone actually using it that way. Is there something wrong with embedding it as a layer or is this just the result of everyone copy/pasting from the original examples?

I should also say that I'm confused about the back propagation component. I'm new to machine learning, but is this effectively happening automatically as a side effect of including it in the model or do I need to change the way that I apply gradients as well?

naddeoa avatar Jul 25 '23 20:07 naddeoa