erZhou
erZhou
Hello, thank you for your very useful codebase. I would like to know how to define a custom gate function in the moe_layer, like self._layer = moe_layer(gate_type={'type': 'custom','module': CustomGate, ......