Zachary Sunberg

Thanks for reporting. I never thought about this, but yeah, QuickPOMDPs seem like a nightmare for serialization. I hope this is not a problem for distributed computing.

I think solvers, belief updaters, and simulators should avoid calling `obs_weight` or `observation` when `s` is terminal. We should not *force* problem implementers to define `obs_weight` or `observation` when `s`...

> What do you mean by use CommonRL directly? By this option, I mean completely deprecating and then removing `RLCore.AbstractEnv` and using `CommonRL.AbstractEnv` and the methods from `CommonRL` everywhere within...

> Doesn't this look more like the effort behind https://github.com/juliareinforcementlearning/commonrlinterface.jl ? CommonRLInterface is more like MathOptInterface.jl than Optimization.jl. It is an interface for RL *environments* that solvers can use, but...

> Every separate repo increases maintainer load, so I would prefer to first increase number of maintainers and then increase the number of repos and not the other way around....

Here is perhaps an explanatory example of why my students have not decided to hook into RL.jl: people using RL for research fall into one of two categories: either they...

> The biggest barrier imo really are the incomplete and outdated documentation and the decrepit state of the packages. Yes, in order to improve this, the community needs to understand...

I will briefly add that my experience in having a bunch of small "tools" packages was quite negative. In POMDPs.jl, we used to have a bunch of different tools packages,...

I vote VERY STRONGLY for NOT MUTATING IN PLACE and focusing on using StaticArrays (or even allowing any AbstractVector or even any type to represent states, etc.)! :) In my...

Cool! I just though of another reason to focus on a more functional/immutable paradigm: it makes auto-differentiation much easier. > my intention is to create a comfortable aircraft simulation framework...