certification-tool

certification-tool copied to clipboard

### Describe the bug Using the "Abort" button during the test run takes a significant amount of time to stop the test. That's mostly noticeable with Thread devices. ### Steps...

EDTEmadH

### Describe the bug Test Harness drops the Quotation-Marks around the WiFi SSID, which leads to a failed Test, cause the chip-tool interprets the WiFi-SSID as multiple Arguments. ### Steps...

Haerteleric

[Bug] [TC-LVL-2.3] Test Harness UI Displays "UNABLE TO PARSE TEST STEP NAME" During Test Execution

2

### Describe the bug During the execution [TC-LVL-2.3] of test case in the Test Harness, the UI displays "UNABLE TO PARSE TEST STEP NAME" instead of showing the actual test...

Rajashreekalmane

[Feature] Python test case validation log - Improve Readability and Structure of Logs for UI Python Test Cases

2

### Feature description The current logs generated during the execution of Python test cases make it difficult to identify individual test steps. Even though the tests pass, the lack of...

Rajashreekalmane

[Bug] Testharness 1.4 selects too many not needed tests

1

### Describe the bug The test plan generator in the Testharness selects far to many tests. Most of these tests are even not applicable to the selected xml file. The...

LarsOesten

Matter Test Harness UI "Certification Mode" not usable (v2.11-beta3.1+fall2024)

1

### Describe the bug The newly introduced "Certification Mode" is not usable in its current form. The user is unable to modify test selection and abort quickly after a failed...

EDTEmadH

[Bug] [Matter 1.4 SVE] [v2.11beta3.1+fall2024] [TC-IDM-10.5] PIXIT.IDM.ALLOW_EXTRA_CLUSTERS_ON_ENDPOINT:true is not passed to the script

1

### Describe the bug All clusters app tested with the argument PIXIT.IDM.ALLOW_EXTRA_CLUSTERS_ON_ENDPOINT:true returned FAILED ### Steps to reproduce the behavior Test parameter: "test_parameters": { "timeout": "100000000", "bool-arg": "allow_provisional:true PIXIT.IDM.ALLOW_EXTRA_CLUSTERS_ON_ENDPOINT:true" }...

SirRu24

[Bug] Silent failure to download results file

5

### Describe the bug When I go to download one specific file, it silently fails to download. I can download it to a different location, and I have no problems...

cecille

[Bug] mDNSResponder: Default: mDNSCoreReceiveResponse: Unexpected conflict discarding

17

### Describe the bug I have installed the latest TH environment ("v2.11-beta3.1+fall2024") on my RPi4. To do so, I have had to upgrade it to Ubuntu 24.04 (A side comment:...

OlivierGre

[test_collection folder missing from backend on fresh installation] SVE-1.4

11

### Describe the bug The test_collection folder and its sub folders from the backend is not installed on a fresh installation of v2.11-beta3.1+fall2024. Unsure how to correct this without re-installing...

SamCullen-Element