Samwise

icon location Lazy ape

Results 1 comments of Samwise

【BUG】occur error：AttributerError：'DeepSpeedHybridEngine' object has no attribute 'mp_group' whiling run llama7b for step3/rlhf/ppo

It seems enable_hybrid_engine only support for OPT models.