Add PL integration test to CI
The current CI only contains the unit tests, but not integration tests with PennyLane. This leads to PRs passing CI but breaking compatibility with PL getting merged.
Here's the integration tests run on the PL plugin test matrix: https://github.com/PennyLaneAI/plugin-test-matrix/blob/master/.github/workflows/braket-latest-latest.yml
Hi @astralcai, taking a look at this test matrix, it installs both the latest PL and latest PL-plugin. I would like to avoid having the build process for PRs being aware of the latest version of dependency. Is the purpose here to have better notifications on the Braket side for incoming breaking changes?
Additionally, it seems we should evaluate the TF and torch versions being used as these are looking to be upgraded:
TF_VERSION: 2.12.0
TORCH_VERSION: 2.0.0+cpu
https://github.com/PennyLaneAI/plugin-test-matrix/blob/master/.github/workflows/braket-latest-latest.yml#L19
This is something I can look at cutting an issue for.
In principle, for the plugins, we want to run CI with the latest version of PennyLane. We only verify that the latest plugin still works with stable PennyLane once a week in the test matrix.
Is the purpose here to have better notifications on the Braket side for incoming breaking changes?
This is exactly the reason. In this release we found out that the latest braket plugin did not work with the soon-to-be-released PennyLane a week before the release, which is something that should've been caught way earlier.
Sorry about the delay, I am getting back to this. I am getting out https://github.com/amazon-braket/amazon-braket-pennylane-plugin-python/pull/264. This will fail until the obs are fixed up.
Fixed with #264