d3rlpy icon indicating copy to clipboard operation
d3rlpy copied to clipboard

Support for additional heads

Open jaak-s opened this issue 2 years ago • 1 comments

I'd be interested to create environments that have add extra data for auxiliary training tasks available (e.g., reward prediction). Is that already possible, thx! I don't mind rewriting some methods to accomplish that if it is reasonably easy to do.

jaak-s avatar Aug 23 '22 23:08 jaak-s

@jaak-s Hi, thanks for the issue. Currently, the multi-head architecture is not planned yet. We could possibly do it by modifying algorithm classes.

takuseno avatar Aug 24 '22 14:08 takuseno