llama-cpp-python icon indicating copy to clipboard operation
llama-cpp-python copied to clipboard

Published 20 hours ago • verified publisher icon abetlen

LLaMA cpp python server: IPV6 support

Open Smartappli opened this issue 1 year ago • 3 comments

Replace uvicorn by hypercorn to support ipv6

Smartappli avatar May 03 '24 20:05 Smartappli

Hey @Smartappli let me consider this, technically you should be able to do by just launching the app directly from the cli via hypercorn correct?

abetlen avatar May 04 '24 14:05 abetlen

Yes correct

https://levelup.gitconnected.com/deploy-fastapi-with-hypercorn-http-2-asgi-8cfc304e9e7a

Smartappli avatar May 04 '24 14:05 Smartappli

@gaby review plz

Smartappli avatar May 05 '24 06:05 Smartappli