chip-n-scale-queue-arranger
chip-n-scale-queue-arranger copied to clipboard
Running Chip N Scale with multiple TFServing images
Currently, Chip N Scale only sends tiles to a single TFServing image, and soon we may need to send a single image to multiple TFServing images for model inference.
cc: @drewbo.