Transformers4Rec icon indicating copy to clipboard operation
Transformers4Rec copied to clipboard

[Task] Add Example for Transformer4Rec Serving Example

Open bschifferer opened this issue 3 years ago • 1 comments

Description

Providing a Serving Example Transformer4Rec

bschifferer avatar Sep 18 '22 09:09 bschifferer

@bschifferer is that with Merlin Systems and Torch backend?

rnyak avatar Sep 20 '22 19:09 rnyak

related to that https://github.com/NVIDIA-Merlin/Transformers4Rec/issues/499

rnyak avatar Oct 19 '22 16:10 rnyak

We ahve an example with python backend. This example with torch script.

viswa-nvidia avatar Nov 08 '22 17:11 viswa-nvidia

@bschifferer , please tag the PR to this ticket

viswa-nvidia avatar Dec 06 '22 18:12 viswa-nvidia

Example is done for serving the model . @rnyak , please tag the PR for this and als createa a ticket for NVTabular example will be tracked separately.

viswa-nvidia avatar Dec 13 '22 17:12 viswa-nvidia

The model serving example was merged via this PR https://github.com/NVIDIA-Merlin/Transformers4Rec/pull/552. For serving NVT +Model as an ensemble, I created this ticket https://github.com/NVIDIA-Merlin/Transformers4Rec/issues/577.

rnyak avatar Dec 13 '22 20:12 rnyak