dacian7

> Has anyone attempted batch inference without sglang? I am noticing that batch size is affecting the output. It looks like batch size is impacting the preprocessing and padding of...

> 有解决吗？ @PangziZhang523 hello，你解决了吗？我也是，但我看 loss 还是正常在下降

> Any solutions? @SuperBruceJia It is not a problem. Just ignore it. Everything is fine. I completed the training and the model is fine