Hang Hoo

By the way, I feel it's a little confusing when the thread is involved, especially asynchronization=False. Do you have any suggestion to debug the program by using breakpoints? Thank you...

Hi Zhouyou, thank you very much for your response. Yes, I found the mutex locks of step() and sample(). May I know what the function of _per_w_multiplier() is? Also, if...

Hi Zhouyou, thank you very much for your detailed explanation. That's very helpful. I have read your paper. On the other hand, I guess the `weights ` in this line...

Thank you very much for your answers. 1. Do you think the multi-head critic architecture can transplant to the Auto entropy SAC? If you can share any references about multi-head...

Hi @zhouyou-gu, thank you very much for all your help.

Hi @zhouyou-gu, a quick question. Is there any reference to support multi-head critic architecture?