chainerrl
chainerrl copied to clipboard
ChainerX support
We should use chainerx where possible for efficiency.
~Links cannot be deepcopied after to_device('native'). We need to find a workaround or wait until it's fixed. https://github.com/chainer/chainer/issues/5916~ solved
Async training requires https://github.com/chainer/chainer/issues/5931 to be fixed.
def deepcopy_link(link):
device = link.device
link.to_device(np)
new_link = copy.deepcopy(link)
link.to_device(device)
new_link.to_device(device)
return new_link
This can be a workaround to deepcopy.
Current ChainerX does not support advanced indexing, which prevents from applying it to CategoricalDQN and IQN. https://github.com/chainer/chainer/issues/5944