Jakob Frick

@Kludex @hasansezertasan @tiangolo since I also would love to use this to simply a bunch of code we have I have fixed lint and added a basic documentation here https://github.com/tiangolo/fastapi/pull/11398

@tiangolo closed my PR as I think they are refactoring that part of the code base, I think he ideally can give an update and a recommendation

Hi @ggerganov would you be open to contribution on this / a slightly more advanced use case. We basically want to run GGML in an interactive process that can accept...

@Green-Sky I assume this can be closed now that #247 is merged

@netom is there a way you would be willing to merge this?