DeepQLearning.jl icon indicating copy to clipboard operation
DeepQLearning.jl copied to clipboard

Support of AbtractEnvironment

Open MaximeBouton opened this issue 4 years ago • 2 comments

This solver uses some function that are broader than the minimal interface defined in RLInterface and relies on internal fields such as env.problem in many places. Ideally, the solver should support an RL environment defined just using RLInterface.jl and without necessarily an MDP or POMDP object associated with it.

MaximeBouton avatar Mar 19 '20 02:03 MaximeBouton

Yes, this is definitely important. In my class, more students had success with this package than any other, but this made it a little confusing to use.

zsunberg avatar Mar 21 '20 17:03 zsunberg

Right now it is really designed to work with POMDPs.jl. Any AbtractEnvironment could technically be implemented using MDP and the generative interface. initialstate, gen and actions is all what's needed I believe.

MaximeBouton avatar Mar 23 '20 01:03 MaximeBouton