certification-tool icon indicating copy to clipboard operation
certification-tool copied to clipboard

[Feature] Python test case validation log - Improve Readability and Structure of Logs for UI Python Test Cases

Open Rajashreekalmane opened this issue 4 months ago • 2 comments

Feature description

The current logs generated during the execution of Python test cases make it difficult to identify individual test steps. Even though the tests pass, the lack of clear separation and labeling between different steps hinders easy understanding and debugging.

Use Cases

Enhancement Requirements: 1. Clear Separation Between Test Steps: Add a clear delimiter or label before each major test step for better visibility in logs.

Example:

----- Starting Step 1: Initialize Test Environment ----- ... ----- Starting Step 2: Verify DUT Connection -----

2. Step Descriptions: Include a brief description of what each test step is performing. For example:

Step 1: Setting up the DUT connection. Step 2: Sending command. Step 3: reading attribute value.

3. Summary of Passed/Failed Steps: At the end of the test, include a summary that highlights the status of all test steps.

Example:

Test Summary:

  • Step 1: PASS
  • Step 2: PASS
  • Step 3: PASS

Test Cases

  1. TC-OPSTATE-2.1
  2. TC-OPSTATE-2.2
  3. TC-OPSTATE-2.3
  4. TC-OPSTATE-2.4
  5. TC-OPSTATE-2.5
  6. TC-OPSTATE-2.6
  7. TC-ACE-1.3
  8. TC-ACE-2.1
  9. TC-ACE-2.2
  10. TC-ACL-2.2
  11. TC-ACL-2.11
  12. TC-SC-7.1
  13. TC-OVENOPSTATE-2.1
  14. TC-OVENOPSTATE-2.2
  15. TC-OVENOPSTATE-2.3
  16. TC-OVENOPSTATE-2.4
  17. TC-OVENOPSTATE-2.6
  18. TC-OVENOPSTATE-2.5
  19. TC-SC-8.1
  20. TC-SC-8.2
  21. TC-SC-8.3
  22. TC-SC-8.4
  23. TC-SC-8.5
  24. TC-SC-8.6
  25. TC-SC-8.7

Example validation log : acl-2-11.log

Rajashreekalmane avatar Sep 27 '24 16:09 Rajashreekalmane