DeepEP icon indicating copy to clipboard operation
DeepEP copied to clipboard

[intranode] when num_tokens change to 65536, then check failed

Open elevenxiang opened this issue 8 months ago • 2 comments

HI

does intranode support num_tokens to 64K ? we met mismatch assert as below

File "/workspace/DeepEP/tests/test_intranode.py", line 135, in test_main assert calc_diff(check_x, ref_x) < 5e-6 AssertionError

Thanks

elevenxiang avatar Apr 17 '25 09:04 elevenxiang

skip recv check, and also found topk_weight check failed assert calc_diff(check_topk_weights, ref_topk_weights) < 1e-9 AssertionError

elevenxiang avatar Apr 17 '25 11:04 elevenxiang

nobody ever changed the num_tokens to 64K ?

elevenxiang avatar Apr 28 '25 02:04 elevenxiang