Dmitry Chichkov comments

Repositories
Issues
Comments

Results 33 comments of


                                            Dmitry Chichkov

Out of RAM using 24.07 container

So far, no more OOMs/sigkill, when free memory target is set to 64GB. But I was only seeing the crash sporadically. `sysctl -w vm.min_free_kbytes=$((64 * 1024 * 1024))`

Add validation set to EvalAI

Thanks! The issue is, we see a consistent gap between validation and test set results. While models did not use the validation set to optimize. Multiple teams resorted to reporting...

[V1] Feedback Thread

Quick feedback [VLLM_USE_V1=1]: - n > 1 would be nice - guided_grammar (or anything guided really) would be nice