Lisen Mu

Question on upper bound

2

@ShibiHe , First of all, thanks for this inspiring paper and implementation, great work! In paper, you use index substitution to derive the upper bound for Q, which perfectly makes...

parameter server integration example

2

Hi, Could you please include tutorial on how to setup & run with parameter server? P.S. congrats for V2 release!

action distribution for estimating V

8

Hi, First of all, thanks for this inspiring work! In https://github.com/haarnoja/softqlearning/blob/59c0bbb7d665616f796ab101de65227c89ffd318/softqlearning/algorithms/sql.py#L164 it seems to me that action is sampled from uniform distribution when estimating `V_{soft}` . In Sec. 3.2. of...

Caffe integration attempt

5

Caffe Integration attempt with parameter_server. This pull request is created not because the code is ready for merge, but to draw attention and ask questions to make better implementation. Thanks....