[RLlib] PolicyServerInput http handler floods output
What happened + What you expected to happen
PolicyServerInput creates in its _make_handler method a http request handler. This handler is a SimpleHTTPRequestHandler and thus haves a log_message method. By default the SimpleHTTPRequestHandler logs every request it gets. This has as a result that the console/log output is flooded whenever a PolicyClient does a request. There is no way to control the output as no log levels are used.
I would expect to be able to control the output by using for example log level 'WARNING', which would then not output all these individual http requests.
A way to solve this would be to implement log_message and log_error in the Handler class, overriding the default behavior of the SimpleHTTPRequestHandler
Versions / Dependencies
Ray: 2.0.0 Python: 3.8.10 OS: Ubuntu 20.04.5
Reproduction script
Can be reproduced using the Cartpole Server example. You will see output like this:
(RolloutWorker pid=1492385) 127.0.0.1 - - [09/Nov/2022 10:36:03] "POST / HTTP/1.1" 200 -
Issue Severity
Low: It annoys or frustrates me.