does lightsq supportting distributed inference?

[dearowen]

does lightsq supportting distributed inference?

[hexisyztem]

If you are talking about multiple models performing inference at the same time, then you can implement multi-card deployment through triton_server, and lightseq provides a solution for docking triton-server