kfeeeeee

Do you still plan to integrate this branch into master / continue work on this?

Oka, thank you. Maybe a good starting point would be oobabooga's text-webui since it's capable of mimicking an openai API on port 5001.