SmartRedis icon indicating copy to clipboard operation
SmartRedis copied to clipboard

Internal pipeline for run_model and run_script commands

Open mellis13 opened this issue 3 years ago • 0 comments

Description When executing run_model and run_script with a Redis cluster, data movement is needed to make sure that the input and output tensors conform to the hash slot data locality requirements for Redis. As a result, the run_model() and run_script() commands actually consist of multiple Redis commands. Pipelining should make these multiple commands more efficient. Note that this is not a feature to expose pipelining the user.

Justification Pipelining the run_model and run_script API calls should increase performance.

Implementation Strategy This feature can be implemented with the pipelining features in underlying redis libraries.

mellis13 avatar Apr 19 '21 16:04 mellis13