connector-plugin-sdk icon indicating copy to clipboard operation
connector-plugin-sdk copied to clipboard

Number of testcases different in Command Line and CSV file/Workbook

Open RafsanMazumder opened this issue 3 years ago • 1 comments

About You: Name: Rafsan Mazumder Company: ByteDance / Tiktok

Your question: The total number of TDVT testcases that are shown in command line is 841 testcases, whereas csv_results_combined / Tableau workbook shows 783 testcases. Which number is correct and what is the reason behind showing 2 different test results count?

Screenshot 2022-01-17 at 4 35 06 PM Screenshot 2022-01-17 at 4 36 26 PM

RafsanMazumder avatar Jan 17 '22 08:01 RafsanMazumder

Hi Rafsan,

csv_results_combined has the accurate number of test cases. The discrepancy in the workbook is likely due to a join issue with the workbook, as the test_metadata.csv file may not have been updated when new tests were added to TDVT (or when existing tests were ). I'm opening an internal story to refresh that workbook, and the metadata it relies on.

pvanderknyff avatar Jun 14 '22 20:06 pvanderknyff

Tracking ID W-12315436, assigned to @tabsdavis

lukewrites avatar Jun 08 '23 18:06 lukewrites