ray icon indicating copy to clipboard operation
ray copied to clipboard

Release test rllib_multi_gpu_with_lstm_learning_tests.aws failed

Open can-anyscale opened this issue 1 year ago • 1 comments

Release test rllib_multi_gpu_with_lstm_learning_tests.aws failed. See https://buildkite.com/ray-project/release-tests-branch/builds/1770#018899d9-32a7-460b-8866-9a696d88211b for more details. cc @rllib

 -- created by ray-test-bot

can-anyscale avatar Jun 08 '23 14:06 can-anyscale

Test has been failing for far too long. Jailing.

can-anyscale avatar Jun 14 '23 00:06 can-anyscale

I looked into the logs and found that this is because we attemt to use the RL Module API in this test, which is, today, not ready. Same goes for the attention test. I will open a PR to fix this.

Screenshot 2023-06-21 at 21 40 09

ArturNiederfahrenhorst avatar Jun 22 '23 04:06 ArturNiederfahrenhorst

Fixed by https://github.com/ray-project/ray/pull/36883. Close to unjail.

can-anyscale avatar Jun 30 '23 20:06 can-anyscale

Test passed on latest run: https://buildkite.com/ray-project/release-tests-branch/builds/1855#01891a8d-b896-453b-abbb-2f172bfb6d7a

can-anyscale avatar Jul 03 '23 12:07 can-anyscale