fondant icon indicating copy to clipboard operation
fondant copied to clipboard

Provide base inference component

Open RobbeSneyders opened this issue 1 year ago • 0 comments

By @philippe-ml6:

Implementing GPU components can be a bit tricky since we need to make sure that both preprocessing and inference are batched, would be nice if we can implement a generic inference transform component class that faciltiates this. A bit similar to Beam's run inference API

RobbeSneyders avatar Oct 29 '23 16:10 RobbeSneyders