Cuong Nguyen

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/4505#018f89a8-8f04-4364-826e-2176d7f53542

CI test **linux://rllib:learning_tests_cartpole_appo_fake_gpus_old_api_stack** is flaky. Recent failures: - https://buildkite.com/ray-project/postmerge/builds/4520#018f8a1c-003b-4696-8abf-d23042cb6a27 - https://buildkite.com/ray-project/postmerge/builds/4505#018f8519-116f-487c-9ce5-fc3ca791106e - https://buildkite.com/ray-project/postmerge/builds/4505#018f84f9-fb09-4ab5-bdc1-160a45fcec68 DataCaseName-linux://rllib:learning_tests_cartpole_appo_fake_gpus_old_api_stack-END Managed by OSS Test Policy

Test passed on latest run: https://buildkite.com/ray-project/postmerge/builds/4538#018f97a7-30a4-41e2-a4d9-2426912ff7bc

@akshay-anyscale, @edoakes i managed to create an environment for the test to run but it fails for some other reasons https://buildkite.com/ray-project/microcheck/builds/237#018f8c35-e5a1-443d-8cf9-bbb481af6c1e/177-2429; if this makes sense feel free to change this...

@aslonnie intended to get merged, but will need serve folks to pick up and finish the job ;)

i rebased the pr to the latest of master to avoid some bugs in ci, my apologies if this interrupt your work in any ways, thankks

Blamed commit: [cf7a09daa201c92d71cffa9f4a8e0afe45ab0475](https://github.com/ray-project/ray/commit/cf7a09daa201c92d71cffa9f4a8e0afe45ab0475) found by bisect job https://buildkite.com/ray-project/release-tests-bisect/builds/1143

This test is now considered as flaky because it has been failing on postmerge for too long. Flaky tests do not run on premerge.

confirmed with @sven1977 that this is a not a weekly release blocker

test is renamed https://github.com/ray-project/ray/commit/72e58561511a7e198f1d2733816ddd9c3d1c4875 so we lost a bit of test history to compute its flakiness; otherwise probably not more flaky than usual