PCGrad
PCGrad copied to clipboard
Questions about GATE_OP
Hi,
Thanks for releasing the code.
I noticed that there is an unused variable named GATE_OP
and is assigned the value 1
at the beginning of the code. GATE_OP
is later passed to gate_gradients
at function compute_gradients
, but the gate_gradients
is neither used ever in the following code.
Would you please give me some idea about the usage of GATE_OP
? Thanks in advance.