Kate Rakelly

Results 7 comments of Kate Rakelly

For discrete action spaces, you can simplify SAC in some ways, since now you can have the soft Q-function output the distribution of Q-values over all actions for a given...

They don't implement SAC with discrete actions in garage, you would have to modify it there as well. I just mentioned it in case it might be a better repo...

Hi, sorry I think I never saw you reopened it! See this issue for the definitions of these metrics: https://github.com/katerakelly/oyster/issues/27

Yes, this only affects the recurrent encoder option, which is currently broken. See Issue 13

Sorry the "recurrent" option is currently broken. It is on my TODO list to fix.

What do you mean? The Datasets take care of loading and pre-processing the data.

What do you mean? These are not the same batches.