Tuan Vu

Cannot convert saved model that uses keras Preprocessing layer

5

Conversion failed from saved model to onnx if the model use `tf.keras.layers.IntegerLookup` and `tf.keras.layers.Discretization`. ### System information - Docker container: `nvcr.io/nvidia/tensorflow:22.12-tf2-py3` - OS Platform and Distribution (e.g., Linux Ubuntu 20.04)...

[QST] How to serve merlin-tensorflow model in Triton Inference Server and convert it to ONNX?

1

# ❓ Questions & Help ## Details Hi, I have been experimenting with an existing TF2 model using the merlin-tensorflow image. This has allowed me to leverage the SOK toolkit...

[BUG] Seg Fault When Deploying TF+HPS Model with merlin-tensorflow

9

**Describe the bug** I've encountered a segmentation fault while deploying a TensorFlow model with Hierarchical Parameter Server (HPS) following the instructions provided in the [HPS TensorFlow Triton deployment demo notebook](https://github.com/NVIDIA-Merlin/HugeCTR/blob/main/hps_tf/notebooks/hps_tensorflow_triton_deployment_demo.ipynb)....

[Question] How can I pre-calculate the GPU memory required for embedding cache size?

2

## Details My company currently operates a Recommender model trained with TensorFlow 2 (TF2) and served on CPU pods. We are exploring the potential of HugeCTR due to its promising...

**Description** - Our ensemble model running on the PyTorch backend in NVIDIA Triton Inference is experiencing performance issues with dynamic batching under high concurrency. - About the ensemble modelThe first...