ep0p comments

Repositories
Issues
Comments

Results 4 comments of


                                            ep0p

'Got cancellation request for SGLang server'

Hi @jakep-allenai, Thank you for your good work. Any solutions for this issue?

'Got cancellation request for SGLang server'

@jakep-allenai I apologize, you were right. Turns out i misunderstood the issue. In fact i was ocr-ing the same document, already been processed before and that is why i had...

fine-tuned llama3.2 models do not provide output while inferencing

more info: when starting the inference i get fast as reply an ``

retrieve training parameters from a lora model?

@danielhanchen No problem, thanks a lot for the answer. in the end i re-did the training and stumbled upon this issue [1756](https://github.com/unslothai/unsloth/issues/1756) I don't understand where the problem could be....