systems icon indicating copy to clipboard operation
systems copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA-Merlin

Integrate HugeCTR into the new Triton ensemble API

Open karlhigley opened this issue 3 years ago • 5 comments

Provide support for serving HugeCTR models in Merlin Systems

karlhigley avatar Feb 01 '22 18:02 karlhigley

@karlhigley , which roadmap ticket does this map to ?

viswa-nvidia avatar Aug 04 '22 00:08 viswa-nvidia

@viswa-nvidia This never mapped to a roadmap ticket, it was started (and mostly completed) on our own initiative during the stretch of time when the roadmap tickets didn't cover Systems.

karlhigley avatar Aug 05 '22 17:08 karlhigley

@oliverholworthy , please link the relevant ticket/PR. Tag the relevant cuDF team in this ticket

viswa-nvidia avatar Sep 12 '22 17:09 viswa-nvidia

Blocked: Oliver cannot run on his laptop

viswa-nvidia avatar Sep 12 '22 17:09 viswa-nvidia

  • Base operator PR here: https://github.com/NVIDIA-Merlin/systems/pull/129
  • Issue opened on HugeCTR here to track the issue with segmentation fault https://github.com/NVIDIA-Merlin/HugeCTR/issues/356

oliverholworthy avatar Sep 12 '22 17:09 oliverholworthy