serve icon indicating copy to clipboard operation
serve copied to clipboard

Why Use TorchScript Format Models?

Open CongSuxu opened this issue 6 months ago • 0 comments

When customizing handler.py, we can load any format of model in the initialize function without needing to package the model into a .mar file. Why do the tutorials recommend converting the model to TorchScript format and packaging it together with handler.py into a .mar file?

CongSuxu avatar Apr 03 '25 09:04 CongSuxu