keras-rl2 icon indicating copy to clipboard operation
keras-rl2 copied to clipboard

Reference to model is changed when training starts

Open Icemole opened this issue 3 years ago • 0 comments

Hello. First of all, I am using version 1.0.3 but the issue holds for the latest (1.0.4) version. My problem is that the reference to my model is being messed up with. I need to use the reference to my created model throughout the training, but as soon as the training starts, it suddenly becomes a reference to an Agent, in my case a DQNAgent.

It would be great not to have any side effects when starting the training, since the model variable could still be used after having started the training, as was my case. I have been searching for solutions and I found out that I was not the only one having problems with this: there are some issues on the original repository which indirectly address this as well. As a result, this library (as well as its predecessor) ends up not being fully compatible with some of the original Keras stuff, such as the TensorBoard callback: see keras-rl/keras-rl#255.

Icemole avatar Mar 31 '21 14:03 Icemole