CQL icon indicating copy to clipboard operation
CQL copied to clipboard

Published 20 hours ago • verified publisher icon BY571

Offline CQL Performance on Atari

Open b-hahn opened this issue 3 years ago • 1 comments

Thanks a lot for the CQL implementation! I wanted to run the offline CQL-SAC for Atari environments and saw your offline training code is for continuous environments only. Have you run any offline experiments on Atari? If so, could you share what level of performance you achieved when compared to online runs? Thanks a lot!

b-hahn avatar Feb 07 '22 11:02 b-hahn

Hey @b-hahn !

Thank you for your comment, indeed I haven't tried (out of personal interest) the discrete action space environments yet. But I think it would be interesting to see. However, currently, I do have not that much time. Maybe over the weekend, I could try and update you here. If you are interested in experimenting with it yourself I have also a discrete SAC implementation. You only had to combine both implementations.

Hope that helps for now! :)

BY571 avatar Feb 07 '22 12:02 BY571