text-generation-inference
text-generation-inference copied to clipboard
feat(router): add ngrok integration
What do you think @Narsil?
Maybe we can hide behind a cargo feature, but then it's a bit of mess in the docker container. We will need to build multiple times with different feature set.