DeepEP
DeepEP copied to clipboard
[intranode] when num_tokens change to 65536, then check failed
HI
does intranode support num_tokens to 64K ? we met mismatch assert as below
File "/workspace/DeepEP/tests/test_intranode.py", line 135, in test_main assert calc_diff(check_x, ref_x) < 5e-6 AssertionError
Thanks
skip recv check, and also found topk_weight check failed assert calc_diff(check_topk_weights, ref_topk_weights) < 1e-9 AssertionError
nobody ever changed the num_tokens to 64K ?