ShenLiang

add random control in save/load

1

add random control in save/load

Fix name of GroupShard

1

Fix name of GroupShard.

[Distributed] Add async offload reload

1

### PR Category Distributed Strategy ### PR Types Performance ### Description [Distributed] Add async offload reload Pcard-67164

[Distributed] Add inplace for c_softmax_with_cross_entropy

1

### PR Category Distributed Strategy ### PR Types Performance ### Description [Distributed] Add inplace for c_softmax_with_cross_entropy

[Cherry-pick] add comm buffer size (#8963)

2

### PR types Performance optimization ### PR changes Others ### Description [Cherry-pick] add comm buffer size (#8963)

Fix checker of nan/inf

2

### PR types Performance optimization ### PR changes Others ### Description Fix checker of nan/inf

[Distributed] Cherry-pick PRs from incubate/fleety

1

### PR Category Distributed Strategy ### PR Types New features ### Description [Distributed] Cherry-pick PRs from incubate/fleety Pcard-67164