app icon indicating copy to clipboard operation
app copied to clipboard

Test ID Case Sensitivity Issue During Import

Open BorshchOleksandr opened this issue 1 year ago • 6 comments

Describe the bug When importing tests, the test IDs are automatically converted to lowercase, causing discrepancies and errors. For instance, @ Sb2... becomes @ sb2 upon import, leading to issues in test identification and execution.

To Reproduce Steps to reproduce the behavior:

  1. Prepare a test file with test IDs in mixed case (e.g., @Sb2...).
  2. Import the test file into Testomat.

Expected behavior Test IDs should retain their original case, ensuring accurate identification and execution.

Screenshots Screenshot 2024-05-27 at 14 08 51 Screenshot 2024-05-27 at 14 30 42 Screenshot 2024-05-27 at 14 31 06

Desktop (please complete the following information):

  • OS: [e.g. iOS]
  • Browser [e.g. chrome, safari]
  • Browser Version [e.g. 22]
  • Application: [production or beta]

Additional context Add any other context about the problem here.

BorshchOleksandr avatar May 27 '24 11:05 BorshchOleksandr

There is the following assumption:

If a number follows @S, the usual test is matched. If a symbol follows @S, the user test is not matched and the first S is displayed as lowercase s.

image

BorshchOleksandr avatar Jun 02 '24 12:06 BorshchOleksandr

@BorshchOleksandr Thanks for the detailed info

Please try version 1.4.3 I have fixed

@testomatio/[email protected]

DavertMik avatar Jun 06 '24 00:06 DavertMik

@DavertMik Thank you, your fix helped resolve the problem with 98% of the tests matching.

However, as I understand, there is still an issue as follows:

When we want to match tests for the second level of nesting, for example, Wallet, TimeLog, or Rise, you can look at our structure in the image.

In this case, the matching does not work based on the Test Suite ID.

image

image

image image image

BorshchOleksandr avatar Jun 06 '24 09:06 BorshchOleksandr

I also noticed that after your last fix, everything in the test name after the parentheses is not considered (it gets cut off) and does not appear in Testomatio.

For example, this did not appear in Testomatio:

(e.g. [email protected]) (e.g. [email protected]) (e.g. test@)

etc.

image

image

BorshchOleksandr avatar Jun 06 '24 09:06 BorshchOleksandr

@DavertMik have you seen the latest details?

TetianaKhomenko avatar Jun 26 '24 08:06 TetianaKhomenko

Can you please say what framework did you use for catch this bug? Or maybe you can send example xml file with this bug please.

I check in few frameworks - maybe this bug was already fixed in last releases... image

trumenov avatar Oct 04 '24 11:10 trumenov

@BorshchOleksandr could you re-check this again? Does the issue still present?

DavertMik avatar Nov 15 '24 13:11 DavertMik

Closing as done due to user's response.

TetianaKhomenko avatar Apr 08 '25 09:04 TetianaKhomenko