ColossalAI
ColossalAI copied to clipboard
[BUG]: The placement policies between Bert example and the stable ColAI are not compatible
🐛 Describe the bug
The placement policy of Gemini plugin in Bert example is "cuda", which is as follows:
However, this policy is not supported by the ColAI (main branch). Existing policy includes "auto" and "static".
Therefore, the error is:
Correct the policy from "cuda" to "auto" can solve this problem and successfully testing:
Thanks.
Environment
No response
Thank you, we will fix this issue as soon as possible.