Rakshith Vasudev

Results 8 comments of Rakshith Vasudev

Just a note if this helps to repro the issue: I had the same issue with v0 also on vllm 0.8.3 I tried running minimax model on 8xH100. No luck....

The key is to make sure old loadgen seed is not optimized. So if this feature is added, the checker should ensure there is no perf improvement.

Agreed, you're correct. The point of this resubmission is not to exactly have the latest scores; but to make a resubmission as is. Not higher or lower performance. This would...

The checker also mentions that file size is large. That's a possible hint. I Don't remember there is an explicit fix it recommends.

Thank you all! Are the flops required to be accurate? Is it okay if the FLOPS numbers are a close estimation? As discussed by others in this thread it's not...

This is a high-impact PR that could really benefit the project. Hoping it can be merged soon—thanks to everyone involved!