neat-gym icon indicating copy to clipboard operation
neat-gym copied to clipboard

Question about dynamic action space and ideal architecture

Open pablogranolabar opened this issue 3 years ago • 0 comments

Hi Simon, thanks for releasing this project!

I am interested in implementing NEAT for function approximation, by sampling data points from two "competing" IoT sensors and then using a simple scoring mechanism to determine which sensor outputs the most correct data points. Problem is, the sensors can output two or three values depending on when they are sampled. Dataset looks like this:

[40, 9] [8, 4]
[42, 1, 3] [9, 22]
[8, 5, 7] [2, 9, 80]
[30, 20] [5, 90]
[1, 20, 90] [90, 7]
[70, 5, 90] [90, 9, 20]
[5, 8, 4] [1, 20, 5]

So should I be zero padding everything so that each sample is exactly three elements, or is it possible to use neat-gym in conjunction with a dynamic Gym observation space?

Would ES-HyperNEAT be the best option for this? Any pointers on implementing neat-gym with strictly integer-valued data would be greatly appreciated!

pablogranolabar avatar Sep 02 '21 00:09 pablogranolabar