DI-engine icon indicating copy to clipboard operation
DI-engine copied to clipboard

feature(pu): add output_activation, output_norm_type, last_linear_layer_init_zero option for MLP

Open puyuan1996 opened this issue 2 years ago • 0 comments

Description

add output_activation, output_norm_type, last_linear_layer_init_zero option for MLP

Related Issue

TODO

Check List

  • [ ] merge the latest version source branch/repo, and resolve all the conflicts
  • [ ] pass style check
  • [ ] pass all the tests

puyuan1996 avatar Oct 11 '22 04:10 puyuan1996