pytorch
Register Workflows at Server Start
🚀 The feature
Register workflows as part of application startup for immediate access to workflow predictions.
Motivation, pitch
Currently, workflows must be registered via the management api at POST /workflows?url=myworkflow.war. This requires some outside manual or automated registration of a workflow that is already thoroughly defined. Workflows should be able to self register based on some additional configuration or by default during application startup.
Alternatives
Provide support for more than one model to be executed within a single handler. This would require some tweaking of how model archiving works, so it seems less desirable. ie. defining a single handler for two model archives.
Additional context
Workflow registration inhibits the usage of torchserve within Vertex as the management api is inaccessible.
It is a must have feature to simplify configuration. curl -X POST tricks on docker startup is ugly
