dfdx
dfdx copied to clipboard
Update Dropout and DropoutOnIn to use Module::forward_mut
They should have the following behavior:
-
Module::forward()
do nothing -
Module::forward_mut()
call dropout (i.e. if there is a tape, then it will modify, otherwise it will do nothing)