Results
2
issues of
G.O.D
1. make `use_reentrant=True` explicit, because it will default to true if it is not assigned 2. fix gradient checkpoint when it used with dropout turned on. if `preserve_rng_state=False`, the dropout...
assume one flop equals two macs