opal icon indicating copy to clipboard operation
opal copied to clipboard

Create E2E tests framework using PyTest

Open danyi1212 opened this issue 1 year ago β€’ 17 comments

We want to create a new baseline framework for writing E2E tests for OPAL Client and Server using PyTest

The test framework should do the following tasks on its baseline/initial run:

  • Run an OPAL Server and Client inside Docker
  • Initially test for health check responsivity
  • Check logs for errors and critical alerts
  • Check the client and server are connected using the Statistics API

The acceptance criteria for this issue is the ability to run a single test command that will be based on the framework specified above and run a very basic assertion test on OPAL

danyi1212 avatar Oct 09 '24 14:10 danyi1212

/bounty 200

gemanor avatar Oct 11 '24 06:10 gemanor

πŸ’Ž $200 bounty β€’ Permit.io

Steps to solve:

  1. Start working: Comment /attempt #677 with your implementation plan
  2. Submit work: Create a pull request including /claim #677 in the PR body to claim the bounty
  3. Receive payment: 100% of the bounty is received 2-5 days post-reward. Make sure you are eligible for payouts

❗ Important guidelines:

  • To claim a bounty, you need to provide a short demo video of your changes in your pull request
  • If anything is unclear, ask for clarification before starting as this will help avoid potential rework
  • Low quality AI PRs will not receive review and will be closed
  • Do not ask to be assigned unless you've contributed before

Thank you for contributing to permitio/opal!

Attempt Started (UTC) Solution Actions
🟒 @Excellencedev Nov 08, 2025, 08:37:47 AM WIP
🟒 @varshith257 Oct 11, 2024, 07:02:06 AM #681 Reward
🟒 @daveads Dec 11, 2024, 11:10:16 AM #717 Reward
🟒 @thekumbhaj Oct 12, 2024, 10:59:52 AM WIP
🟒 @MAVRICK-1 Jul 23, 2025, 05:19:33 PM WIP
🟒 @Rmorales123 Apr 24, 2025, 03:47:01 AM WIP

algora-pbc[bot] avatar Oct 11 '24 06:10 algora-pbc[bot]

/attempt #677

Algora profile Completed bounties Tech Active attempts Options
@varshith257 15 bounties from 7 projects
Go, TypeScript,
Scala & more
Cancel attempt

varshith257 avatar Oct 11 '24 07:10 varshith257

πŸ’‘ @varshith257 submitted a pull request that claims the bounty. You can visit your bounty board to reward.

algora-pbc[bot] avatar Oct 11 '24 09:10 algora-pbc[bot]

/bounty 200

thekumbhaj avatar Oct 12 '24 10:10 thekumbhaj

/attempt 200

Options

thekumbhaj avatar Oct 12 '24 10:10 thekumbhaj

Hi maintainers, I'd like to ask how you generally proceed on bounties please. Can I also submit a PR or it's first come, first serve ? Thanks.

tobihans avatar Oct 12 '24 21:10 tobihans

@tobihans Yes, this repo prefers FCFS towards bounty issues. I already have good progress on it and waiting for @gemanor / @danyi1212 to get review my open PR and also to get assigned

varshith257 avatar Oct 12 '24 21:10 varshith257

That's noted @varshith257. I took a look at your approach also in the PR. Do you mind us collaborating to release a better solution ?

tobihans avatar Oct 13 '24 15:10 tobihans

@tobihans Thanks for asking but work is almost complete except getting review and add assertion test of opal.

Let's collaborate on the other issues

varshith257 avatar Oct 13 '24 15:10 varshith257

Ok then.

tobihans avatar Oct 13 '24 18:10 tobihans

/attempt #677

Algora profile Completed bounties Tech Active attempts Options
@daveads Β Β Β 2 Permitio bounties
+ 7 bounties from 4 projects
Python, Shell,
Go & more
﹟12, ﹟716
Cancel attempt

daveads avatar Dec 11 '24 11:12 daveads

πŸ’‘ @daveads submitted a pull request that claims the bounty. You can visit your bounty board to reward.

algora-pbc[bot] avatar Dec 11 '24 11:12 algora-pbc[bot]

Hey @gemanor is this issue open to work. Thank You.

Mayank77maruti avatar Feb 04 '25 10:02 Mayank77maruti

Hey @gemanor is still open ?

Aksshay88 avatar Apr 06 '25 16:04 Aksshay88

attempt #677 working on it

Rmorales123 avatar Apr 24 '25 02:04 Rmorales123

/attempt #677

Here’s the plan I’ll follow for the E2E test setup:

  1. Set up the test environment using Docker Compose to run the OPAL client and server.
  2. Create a tests/e2e/ folder and initialize PyTest for E2E testing.
  3. Write a base test that performs a health check on the OPAL server.
  4. Add log inspection to confirm there are no critical errors on startup.
  5. Use the Statistics API to verify that the client and server are properly connected.
  6. Make sure all tests run through a single PyTest command.+

Rmorales123 avatar Apr 24 '25 03:04 Rmorales123

/bounty 200

blocator23 avatar Jun 30 '25 19:06 blocator23

/attempt #677

MAVRICK-1 avatar Jul 23 '25 17:07 MAVRICK-1

is this still available ?

cosmadragos73 avatar Aug 05 '25 13:08 cosmadragos73

/attempt #677

Excellencedev avatar Nov 08 '25 08:11 Excellencedev