Brayden Zhong
Brayden Zhong
Hi @aikitoria, I know this is unrelated -- do you have the code anywhere to get it running on vLLM? Many thanks!
@jeremyphilemon Sorry to bother you but noticed you were active here; would you mind taking a look? Thanks in advance!
@adam-from-meiro Glad you found it helpful :)
Yep; thanks for the notif.. checking it out
@tovacinni Thoughts?
@Dcallies I know this was a long time ago... is this still relevant? `fetch_value_merge()` is still there. Can do this if you want
It seems it was closed by accident in https://github.com/sgl-project/sglang/pull/5621, it doesn't actually fix it as it occurs regardless of the embeddings endpoint. I will reopen this since it seems like...
Hey just wondering if this project will still be maintained in the future? Would be sad to have it abandoned.
Complete in https://github.com/sgl-project/sglang/pull/3680