How do I perform Batch Inference for TSR?

[aashishpokharel]

I have a pdf and have converted it to the images. Now I want to pass it through the TETR for Table Structure Recognition. Is there a way to run Inference with batch size > 1 for TSR? Can it be done using the inference.py or I need to run in the eval mode?

[NielsRogge]

Hi,

Batched inference is supported by default in the Transformers library as shown here. Just pass multiple images to the image processor, and multiple target sizes to the post_process_object_detection method.