pytorch-A3C icon indicating copy to clipboard operation
pytorch-A3C copied to clipboard

Shared local and global parameters

Open mfl22 opened this issue 1 year ago • 0 comments

Shouldn't parameters of local and global networks be synchronized: https://github.com/MorvanZhou/pytorch-A3C/blob/5ab27abee2c3ac3ca921ac393bfcbda4e0a91745/discrete_A3C.py#L73 lnet and gnet are not initialized with the same parameters here ? Probably lnet.load_state_dict(gnet.state_dict()) is missing.

For example, see implementation in https://github.com/ikostrikov/pytorch-a3c/blob/48d95844755e2c3e2c7e48bbd1a7141f7212b63f/train.py#L37.

mfl22 avatar Mar 26 '24 12:03 mfl22