reinforcement-learning icon indicating copy to clipboard operation
reinforcement-learning copied to clipboard

Why is Chapter 11 excluded?

Open BedirT opened this issue 5 years ago • 2 comments

Hi,

I can't really see why is chapter 11, function approximation with off-policy methods are excluded in the function approximation chapter? It is essential, plus the exercises basically are in chapter 11 rather than 9&10 (Q-Learning with f.a.). Can someone tell me if there is a particular reason?

BedirT avatar Feb 03 '20 23:02 BedirT

Hi! There is no specific reason. I think when I wrote the code in this repository chapter 11 was not yet fully completed or published.

dennybritz avatar Feb 04 '20 06:02 dennybritz

I think we should add it then, cuz the concepts are different for on-policy off-policy.

BedirT avatar Feb 04 '20 08:02 BedirT