convnetjs
convnetjs copied to clipboard
karpathy
[Suggestion for "Painting"] Use of Fourier Features?
Hello,
On the page titled "Image Painting" I wanted to suggest passing the (x, y) points through a Fourier feature mapping. The details on this are described here in this 2020 NeurIPS paper by Google Research (including example code).
Admittedly I'm not sure if this would be out of scope for an intro example for this library, but it would be very cool to see the neural net be able to paint the cat clearly.
Btw thanks for sharing this great work! I originally found this repo when I was in undergrad, it was part of what got me excited about computer vision :)
Specifically for implementation, it might be good to find a NumPy equivalent for JS. Reading around it looks like numjs is a good option
Update: could also be a good idea to write a new type of layer class for this library, for easier incorporation into linear models
^hi again @371148606 - I figured out a way to implement this just using the existing utility functions (credit @karpathy :) ). Would be great to get some feedback!