pytorch_backend icon indicating copy to clipboard operation
pytorch_backend copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

Enable configurable deterministic algorithm flag

Open yhna940 opened this issue 7 months ago • 0 comments

This PR introduces a new model configuration parameter, ENABLE_DETERMINISTIC_ALGORITHMS, to control whether PyTorch runs with deterministic algorithms enabled.

  • Adds enable_deterministic_algorithms_ flag in ModelState
  • Parses the flag from model configuration
  • Calls at::globalContext().setDeterministicAlgorithms(...) during model execution
  • Updates README.md to document the new parameter

When enabled, operations without deterministic implementations will raise errors. Default behavior remains unchanged (disabled).

yhna940 avatar May 05 '25 08:05 yhna940