Adarsh Shirawalmath comments

Results 15 comments of


                                            Adarsh Shirawalmath

Refactor LLVM to not use llvmlite for rendering

Can use codegen?

I get this error lol

Ya just spin up a local server in the working dir

Support for local/opensource Models

Yes support for open source self hosted LLMs could be useful. Falcon 40B Or MPT 30B. But the models have to be fine tuned specifically for this I guess.

Can I hook it up to a retrieval system for a document chatbot?

@bulletproofmedic do let me know if you get somewhere lol thanks

[Bug] Please support mistral3 architecture

OTW!

torch2.0.1 No module named 'torch._six

Any fixes? I ran into this error EDIT: `pip uninstall -y apex` This fixed the issue for me since I wasn't using apex anyways

torch2.0.1 No module named 'torch._six

> help, save my ass !!!!!! `pip uninstall apex` 🤡

model(vlm): mistral 3.1

Priority for this PR please! @ch-wan @minleminzui @zhaochenyang20

[Bug] [SECURITY] Critical security incidents of SGLang

will be submitting relevant fixes. Thank you

[Bug] [SECURITY] Critical security incidents of SGLang

@Swipe4057 Thank you for your evaluations. Please feel free to open PRs to support these new images. We will review the same. The current vulnerability @avilum mentions is related to...