DI-engine
DI-engine copied to clipboard
feature(pu): add output_activation, output_norm_type, last_linear_layer_init_zero option for MLP
Description
add output_activation, output_norm_type, last_linear_layer_init_zero option for MLP
Related Issue
TODO
Check List
- [ ] merge the latest version source branch/repo, and resolve all the conflicts
- [ ] pass style check
- [ ] pass all the tests