sutton_and_barto
sutton_and_barto copied to clipboard
Wrong answer 2.1
If we have 2 actions and $\varepsilon=0.5$, the probability of selecting the greedy action is $0.5 + 0.25=0.75$. We add $0.25$ because we may select a random action with $\varepsilon=0.5$ which can be the greedy action itself. Since there are 2 actions, the "random" probability will be distributed equally $\frac{0.5}{2}=0.25$.