ethan-digi
ethan-digi
@schetlur-nv How can this be enabled through `trtllm-build` or `launch_triton_server.py`? Is this enabled by default? edit: for future users, it's in config.pbtxt
@schetlur-nv, thank you very much. Regarding the info on that page, consider a prompt structured as: "Please ask [user] how their day is going. Be sure to greet them by...
> Have you tried lowering learning rate? Yes, I have thought of lowering the learning rate 😆. I'm just looking for some loss curves known to produce desirable results so...
I can confirm, at least for train_finetune.py, that the lrs are not adjusted for any of the models