[HELP] In my train OpenSora1.0 process， I got zhe error ['LowLevelZeroOptimizer' object has no attribute '_param_store'], how to fix it？

[pqhgit]

Traceback (most recent call last): File "/xxx/OpenSora1.0/scripts/train.py", line 328, in main() File "/xxx/OpenSora1.0/scripts/train.py", line 270, in main update_ema(ema, model.module, optimizer=optimizer) File "/usr/local/python-3.10.13/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "/xxx/OpenSora1.0/opensora/utils/train_utils.py", line 31, in update_ema master_param = optimizer._param_store.working_to_master_param[param_id] AttributeError: 'LowLevelZeroOptimizer' object has no attribute '_param_store'

I can't find any class with 'LowLevelZeroOptimizer' or '_param_store' in this project, how to fix it？

[narrowsnap]

In my experiments, I change it to master_param = optimizer.working_to_master_param[param_id].

[pqhgit]

@narrowsnap this worked, thx

[pqhgit]

modify /xxx/OpenSora1.0/opensora/utils/train_utils.py", line 31 -> master_param = optimizer.working_to_master_param[param_id] solved.

[tyz1994]

pip install colossalai==0.4.0

[github-actions[bot]]

This issue is stale because it has been open for 7 days with no activity.

[github-actions[bot]]

This issue was closed because it has been inactive for 7 days since being marked as stale.

[Texaser]

After changing it to master_param = optimizer.working_to_master_param[param_id], I still have the AttributeError: : 'LowLevelZeroOptimizer' object has no attribute 'working_to_master_param'. Can anyone help?

[narrowsnap]

After changing it to master_param = optimizer.working_to_master_param[param_id], I still have the AttributeError: : 'LowLevelZeroOptimizer' object has no attribute 'working_to_master_param'. Can anyone help?

What's your version of colossalai?