TorchScript server

[lutzroeder]

Prototype exploring to use the Python Server to load and serve TorchScript models.

Example:

import torch
import torchvision
import netron
model = torchvision.models.resnet34()
model = torch.jit.script(model)
traced_model = torch.jit.trace(model, torch.zeros([1, 3, 224, 224]), strict=True)
torch._C._jit_pass_inline(traced_model.graph)
netron.serve('resnet34', traced_model)

[HLearning]

netron not open fasterrcnn_resnet50_fpn.pt Python Error AssertionError: targets should not be none when in training mode