I keep getting almost grayscale images instead of colored images as shown in the paper

[hiskuDN]

I trained both universal and targeted adversarial patches. The paper shows the image below:

But my generated images seem to be almost gray scale, I was wondering if this was an issue in the code or my custom dataset? I'm trying to train for a single person to test targeted identity spoofing. Below is my generated image: