Why TorchServe Don't Supply Authentication?

[BeomseoChoi]

🚀 The feature

Should support authentication features.

Motivation, pitch

I'm using TorchServe to serve my deep learning model. The initial purpose that I use this framework was just to inference from local server which is in bound. Now, I would like to open my TorchServe server to public. For this, I need to grant something for authentication such as token to others who use my server. But from https://pytorch.org/serve/configuration.html, they say that TorchServe doesn't support authentication.

Alternatives

No response

Additional context

Does TorchServe have a plan to support authentication features? if so, when it will be at?

[lxning]

TorchServe support SSL authentication (see details).

For token based authentication, there is a ticket to track this request. It is on our roadmap.

[namannandan]

Token authorization is now supported in TorchServe 0.10.0: https://github.com/pytorch/serve/blob/v0.10.0/docs/token_authorization_api.md