T.J. Gaffney
T.J. Gaffney
The code in update_values does: ``` ... self.visit_count += 1 self.q_value += leaf_value / self.visit_count ... ``` So that if you call this three times with leaf_value 3, 4, 5,...
Following #1300, we can make logic to run get_memory_from_transitions on the transitions variable in FSMs in order to get memory depth.
When we run all the unittests, it prints out stuff besides just the test results. I think it would be nice if this wasn't there. It would be cleaner. And...
If we're using black to format, I'd prefer to run on existing code. If we format as we go it can be harder to see why we're changing something. It...
Have you thought about adding functionality for Python-style negative indices on the slice function?