python_backend

python_backend copied to clipboard

Extend Logging to the python backend

1

Triton server logging functionality can now be invoked from python models. Here are a few example formats: ```python logger = pb_utils.Logger logger.log("Specific Msg!", logger.INFO) logger.log_info("Info Msg!") logger.log_warn("Warning Msg!") logger.log_error("Error Msg!")...

fpetrini15

core: https://github.com/triton-inference-server/core/pull/109 example: if model has below config and build with ENABLE_GPU=OFF: ``` name: "add_sub" backend: "python" input [ ... ] output [ ... ] # not providing instance group...

GuanLuo

jbkyang-nvi

Tabrizian

When using the python backend, if the shm-default-byte-size or shm-growth-byte-size is set larger than 2 * 1024 * 1024 * 1024 bytes, the tritonserver will fail to start Start command...

wangchengdng

fpetrini15

Fix if statement in setup-pre-container.sh

1

mattaltberg

This commit introduces a debug mode for the Triton Python backend. When the environment variable `TRITON_DEBUG` is set to "1", the backend will import the `debugpy` module and start listening...

so2bin

rmccorm4

Add shared memory leak debugging introspection

Tabrizian