[DRAFT] ppo chess with llm and ConditionalPolicySwitch to sunfish bot

[mikaylagawarecki]

Stack from ghstack (oldest at bottom):

• -> #2763
• #2711
• #2709

[pytorch-bot[bot]]

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2763

• :page_facing_up: Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

:heavy_exclamation_mark: 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• ROCM Infra failures during checkout of PyTorch

:x: 7 New Failures, 8 Unrelated Failures

As of commit f5d2b1509d3cf5940a25a4e47f28fe649da756f6 with merge base dbc8e2ee03f463fe760a262790a6275cbed75b27 ():

NEW FAILURES - The following jobs have failed:

• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cpu (gh) Unable to download artifact(s): Artifact not found for name: pytorch_rl__3.9_cpu_
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda11_8 (gh) Unable to download artifact(s): Artifact not found for name: pytorch_rl__3.9_cu118_
• Continuous Benchmark (PR) / CPU Pytest benchmark (gh) Process completed with exit code 1.
• Continuous Benchmark (PR) / GPU Pytest benchmark (gh) Process completed with exit code 1.
• Lint / python-source-and-configs / linux-job (gh)
• Unit-tests on Linux / tests-olddeps (3.8, 11.6) / linux-job (gh) RuntimeError: Command docker exec -t d906bf47af140328be841eeaa45ac797c28f05c3a86210463469146039489e23 /exec failed with exit code 1
• Unit-tests on Windows / unittests-cpu / windows-job (gh) Process completed with exit code 1.

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda12_4 (gh) (trunk failure) Unable to download artifact(s): Artifact not found for name: pytorch_rl__3.9_cu124_
• Build Windows Wheels / pytorch/rl / upload / wheel-py3_9-cuda12_6 (gh) (trunk failure)
• Habitat Tests on Linux / tests (3.9, 12.4) / linux-job (gh) (trunk failure) AttributeError: _ARRAY_API not found
• Unit-tests on Linux / tests-optdeps (3.11, 12.4) / linux-job (gh) (trunk failure) test/test_transforms.py::TestTokenizer::test_transform_inverse
• Wheels / build-wheel-windows (3.10, 3.10.3) (gh) (trunk failure) This request has been automatically failed because it uses a deprecated version of actions/upload-artifact: v3. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
• Wheels / build-wheel-windows (3.11, 3.11) (gh) (trunk failure) This request has been automatically failed because it uses a deprecated version of actions/upload-artifact: v3. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/
• Wheels / build-wheel-windows (3.12, 3.12) (gh) (trunk failure)
• Wheels / build-wheel-windows (3.9, 3.9) (gh) (trunk failure) This request has been automatically failed because it uses a deprecated version of actions/upload-artifact: v3. Learn more: https://github.blog/changelog/2024-04-16-deprecation-notice-v3-of-the-artifact-actions/

This comment was automatically generated by Dr. CI and updates every 15 minutes.