André Bauer

[BUG] `max_in_cpu` seems to be ignored?

5

**Describe the bug** I evaluate `OPT-66B` with Zero3 and set offloading to `nvme` which works fine, but I also increased `max_in_cpu` to 100G printed as ``` DeepSpeedZeroOffloadParamConfig(device='nvme', nvme_path=PosixPath('/tmp'), buffer_count=5, buffer_size=100000000,...