Benjamin Botwin

I know it's on their roadmap, but am I wrong in thinking that this (https://github.com/vllm-project/vllm/blob/acbed3ef40f015fcf64460e629813922fab90380/vllm/model_executor/layers/sampler.py#L94C33-L94C33) is logit bias? It looks like it's already implemented in there.

okay, seems like this happens when temperature is 0. after removing that param I'm seeing text being generated, but it contains some weird tokens. Any idea what's up with that...

> openai_api_base = "http://0.0.0.0:65530/api/oai" 0.0.0.0 means any local ip use 127.0.0.1 maybe It's not an issue with connecting to the api. The output contains weird tokens

@cryscan I'll give that a shot next time I'm messing around with rwkv. From what I remember though, it'd happen even if i only put the word "Hello" as the...

Happened upon this issue and a relevant stack overflow link. https://security.stackexchange.com/questions/121971/will-same-site-cookies-be-sufficient-protection-against-csrf-and-xss Seems like CSRF protection is still a pretty important practice. Hope it's helpful :)

> But first, note that a 1kg, 1m^3 cube is 1/10th the density of an aerogel, it makes for a rather extreme default case. Wow, i didn't actually know that....

Ah thanks for pointing this out. :pray: The hardcoded dist paths may be a bit rough. Not sure if those exist before you `npm run build`. I've been (slowly :sweat_smile:...

@bbortt Oh definitely :) I'll make my fork public once I get all the tests to pass using expressjs instead of koa. Until then it's a little to chaotic to...

Seeing the same issue on osx :(

Unfortunately, I don’t actually have write access, so I can’t merge 😅