Guacho

I want to integrate a system of ODEs backward in time over some interval. Then I want to measure the initial boundary conditions and differentiate with respect to the parameters...

Should time_step_spec of an array valued reward return an array valued discount?

1

The time_step_spec function only takes observation_spec and reward_spec array specifications, but if the reward_spec specifies a multidimensional array, shouldn't the discount_spec match its shape or at least accept an argument...