DiscreteValueIteration.jl icon indicating copy to clipboard operation
DiscreteValueIteration.jl copied to clipboard

Option for Setting Gauss-Seidel Value Iteration

Open etotheipluspi opened this issue 8 years ago • 2 comments

Currently, the solver only supports Gauss-Siedel value iteration. We should have an optional flag to do value iteration without the Gauss-Siedel method if the user wishes. There are a few ways to do this. The two most straightforward ways:

  1. Have two different solver types with their respective solve functions

  2. Have a flag that looks something like gauss_siedel::Bool as a field in the current ValueIterationSolver type without adding another type or solve() function.

Can this be done more elegantly? @zsunberg if I recall you were dealing with something similar to this in MCTS, any input here?

etotheipluspi avatar Dec 19 '16 18:12 etotheipluspi

I'm okay with either.

mykelk avatar Dec 19 '16 18:12 mykelk

My gut feeling is that the flag is adequate since most of the functionality and options are the same. Actually I didn't think too much about this for MCTS. It may have been better to do dpw with a flag.

zsunberg avatar Dec 19 '16 23:12 zsunberg