libtorch-gin-api-server icon indicating copy to clipboard operation
libtorch-gin-api-server copied to clipboard

verified publisher icon shunk031
→

Metadata

High-speed Deep learning API Server with Libtorch (C++) and Gin (Golang)

High-speed Deep learning API Server with Libtorch (C++) and Gin (Golang)

GitHub license Golang 1.9 Python 3.7

Convert your model to torch script

$ python convert_to_torch_script_via_tracing.py
# converted model is saved to assets/model.pt

How to Run

$ docker-compose up api

Credits

Parts of the implementation is borrowed from rai-project/go-pytorch.

← Metadata

17
Stars
3
Forks
Watchers

Owner

verified publisher icon shunk031

Metadata

High-speed Deep learning API Server with Libtorch (C++) and Gin (Golang)

Back