ColossalAI
ColossalAI copied to clipboard
[Gemini] more rigorous unit tests for run_fwd_bwd
What's the PR for
Previously, Gemini is only checked on GPT2. After increasing the types of test models, the unitest test fails.
You can merge this PR. But @1SAA has to keep an eye on it.