doris
doris copied to clipboard
apache
[enhancement](testutil)Add unit testing functionality
Proposed changes
Enhance error reporting by overriding gtest virtual functions to provide more detailed information
here's an example: [==========] Running 1 test from 1 test suite. [----------] Global test environment set-up. [----------] 1 test from function_string_test [ RUN ] function_string_test.function_string_substr_test /mnt/disk2/heshicheng/doris/be/test/vec/function/function_test_util.h:346: Failure Expected equality of these values: expect_data Which is: "F" column_data Which is: "E" at row 5 arg1 arg2 arg3 Error occurred in case5 /mnt/disk2/heshicheng/doris/be/test/vec/function/function_test_util.h:346: Failure Expected equality of these values: expect_data Which is: "F" column_data Which is: "E" at row 0 const arg1 arg2 arg3 Error occurred in case5
Further comments
If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...
Thank you for your contribution to Apache Doris. Don't know what should be done next? See How to process your PR
Since 2024-03-18, the Document has been moved to doris-website. See Doris Document.
TeamCity be ut coverage result: Function Coverage: 35.21% (8926/25351) Line Coverage: 27.04% (73536/271973) Region Coverage: 26.21% (37986/144938) Branch Coverage: 23.04% (19354/84012) Coverage Report: http://coverage.selectdb-in.cc/coverage/9f7519c78383cd2dede7422c4cca8e03aebabe86_9f7519c78383cd2dede7422c4cca8e03aebabe86/report/index.html
TeamCity be ut coverage result: Function Coverage: 35.20% (8924/25351) Line Coverage: 27.03% (73518/271973) Region Coverage: 26.21% (37986/144938) Branch Coverage: 23.03% (19350/84012) Coverage Report: http://coverage.selectdb-in.cc/coverage/1cbaf5153aab6fd6d844539109f91fb1cc2c9afb_1cbaf5153aab6fd6d844539109f91fb1cc2c9afb/report/index.html
TPC-H: Total hot run time: 40859 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1cbaf5153aab6fd6d844539109f91fb1cc2c9afb, data reload: false
------ Round 1 ----------------------------------
q1 17581 4278 4227 4227
q2 2010 188 185 185
q3 10474 1200 1235 1200
q4 10193 761 805 761
q5 7519 2711 2727 2711
q6 222 130 132 130
q7 1041 635 604 604
q8 9217 2095 2081 2081
q9 10082 6813 6712 6712
q10 9753 3920 3877 3877
q11 428 240 246 240
q12 511 213 219 213
q13 17404 3105 3182 3105
q14 293 239 237 237
q15 517 478 462 462
q16 477 380 393 380
q17 968 691 757 691
q18 8278 7880 7630 7630
q19 3540 1505 1471 1471
q20 637 322 320 320
q21 5296 3352 4106 3352
q22 322 270 277 270
Total cold run time: 116763 ms
Total hot run time: 40859 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4485 4373 4377 4373
q2 379 265 262 262
q3 3230 2925 2997 2925
q4 1848 1543 1564 1543
q5 5457 5505 5514 5505
q6 210 129 127 127
q7 2354 1986 1999 1986
q8 3242 3450 3349 3349
q9 8805 8831 8834 8831
q10 4013 3745 3894 3745
q11 582 496 493 493
q12 796 627 650 627
q13 17014 3113 3123 3113
q14 309 291 287 287
q15 534 480 476 476
q16 486 438 458 438
q17 1796 1487 1462 1462
q18 7609 7731 7393 7393
q19 1621 1508 1486 1486
q20 1964 1761 1770 1761
q21 11480 4690 4818 4690
q22 554 488 478 478
Total cold run time: 78768 ms
Total hot run time: 55350 ms
TPC-DS: Total hot run time: 186039 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1cbaf5153aab6fd6d844539109f91fb1cc2c9afb, data reload: false
query1 909 373 349 349
query2 6434 2467 2352 2352
query3 6651 200 205 200
query4 23220 21389 21239 21239
query5 4087 407 419 407
query6 264 189 180 180
query7 4594 284 288 284
query8 244 193 173 173
query9 8490 2335 2301 2301
query10 429 247 259 247
query11 14717 14098 14243 14098
query12 144 90 89 89
query13 1657 395 371 371
query14 8871 7612 7696 7612
query15 236 175 175 175
query16 7158 266 258 258
query17 1127 577 583 577
query18 1919 273 273 273
query19 205 154 151 151
query20 92 88 85 85
query21 204 133 127 127
query22 5050 4786 4863 4786
query23 33656 33207 33131 33131
query24 5135 3016 2950 2950
query25 494 383 387 383
query26 684 155 154 154
query27 1834 320 315 315
query28 3584 2006 1990 1990
query29 838 631 612 612
query30 247 154 156 154
query31 898 750 735 735
query32 61 55 59 55
query33 393 253 248 248
query34 846 474 474 474
query35 773 676 672 672
query36 1121 894 885 885
query37 107 65 68 65
query38 3105 3010 2999 2999
query39 1548 1527 1539 1527
query40 195 126 125 125
query41 43 39 39 39
query42 102 93 100 93
query43 592 547 566 547
query44 1028 710 733 710
query45 273 255 275 255
query46 1050 689 701 689
query47 1904 1861 1868 1861
query48 361 287 292 287
query49 739 390 396 390
query50 761 372 388 372
query51 6847 6879 6690 6690
query52 102 86 89 86
query53 350 285 276 276
query54 269 244 237 237
query55 78 71 72 71
query56 233 219 216 216
query57 1192 1129 1138 1129
query58 212 198 200 198
query59 3594 3190 3250 3190
query60 249 231 232 231
query61 92 87 86 86
query62 533 449 444 444
query63 311 282 278 278
query64 7409 7108 7054 7054
query65 3067 3041 3049 3041
query66 664 331 339 331
query67 15566 14928 15153 14928
query68 7444 523 529 523
query69 558 308 311 308
query70 1190 1130 1058 1058
query71 532 303 267 267
query72 8092 2604 2450 2450
query73 714 313 314 313
query74 6443 6112 6139 6112
query75 3984 2671 2636 2636
query76 4085 981 1006 981
query77 571 260 260 260
query78 10996 10440 10221 10221
query79 11644 524 509 509
query80 1810 443 433 433
query81 501 221 248 221
query82 1540 91 97 91
query83 231 166 167 166
query84 275 82 84 82
query85 983 262 255 255
query86 464 306 279 279
query87 3430 3043 3087 3043
query88 4954 2340 2331 2331
query89 564 373 374 373
query90 2177 178 178 178
query91 121 95 96 95
query92 66 46 47 46
query93 7255 510 496 496
query94 1071 179 175 175
query95 373 299 296 296
query96 587 266 270 266
query97 3166 2953 2977 2953
query98 237 229 213 213
query99 1269 872 882 872
Total cold run time: 287169 ms
Total hot run time: 186039 ms
TeamCity be ut coverage result: Function Coverage: 35.53% (8925/25122) Line Coverage: 27.18% (73521/270476) Region Coverage: 26.36% (37975/144056) Branch Coverage: 23.16% (19350/83550) Coverage Report: http://coverage.selectdb-in.cc/coverage/e3814537a4ae87a8f4759c716a9a0fdf3d3c5441_e3814537a4ae87a8f4759c716a9a0fdf3d3c5441/report/index.html
TPC-DS: Total hot run time: 186502 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e3814537a4ae87a8f4759c716a9a0fdf3d3c5441, data reload: false
query1 896 358 341 341
query2 6293 2353 2279 2279
query3 6650 197 201 197
query4 23728 21984 22077 21984
query5 3936 447 422 422
query6 257 170 162 162
query7 4753 295 289 289
query8 235 187 213 187
query9 8444 2359 2355 2355
query10 403 254 259 254
query11 15210 14730 14870 14730
query12 122 84 88 84
query13 1661 370 362 362
query14 9828 8399 7173 7173
query15 255 182 171 171
query16 8130 256 246 246
query17 1743 545 527 527
query18 2082 267 265 265
query19 320 144 147 144
query20 90 85 84 84
query21 193 126 132 126
query22 4981 4817 4781 4781
query23 33567 33163 33307 33163
query24 10992 2953 2930 2930
query25 602 371 362 362
query26 1242 143 147 143
query27 2949 302 311 302
query28 7614 2009 1984 1984
query29 849 586 601 586
query30 245 149 144 144
query31 923 708 722 708
query32 91 48 50 48
query33 730 240 239 239
query34 1010 465 474 465
query35 783 665 667 665
query36 1061 885 918 885
query37 120 65 72 65
query38 3141 2987 3018 2987
query39 1583 1533 1524 1524
query40 202 125 121 121
query41 42 37 35 35
query42 101 94 95 94
query43 576 537 526 526
query44 1160 711 713 711
query45 276 265 255 255
query46 1067 718 705 705
query47 1950 1833 1872 1833
query48 386 295 297 295
query49 893 431 399 399
query50 752 391 367 367
query51 6694 6710 6577 6577
query52 101 88 92 88
query53 346 281 288 281
query54 301 235 236 235
query55 81 72 71 71
query56 249 225 224 224
query57 1206 1132 1120 1120
query58 228 205 204 204
query59 3466 3119 3185 3119
query60 259 243 234 234
query61 107 109 104 104
query62 650 454 473 454
query63 302 282 283 282
query64 8597 7290 7244 7244
query65 3107 3072 3051 3051
query66 951 337 336 336
query67 15840 14927 15281 14927
query68 9470 540 537 537
query69 586 306 311 306
query70 1391 1131 1053 1053
query71 510 360 265 265
query72 8392 2568 2393 2393
query73 1595 315 343 315
query74 6515 6049 6047 6047
query75 4753 2659 2638 2638
query76 5835 929 928 928
query77 692 263 259 259
query78 11058 10193 10191 10191
query79 12624 509 514 509
query80 2301 433 419 419
query81 514 227 218 218
query82 480 94 90 90
query83 211 160 159 159
query84 263 85 80 80
query85 1148 283 250 250
query86 332 311 316 311
query87 3316 3047 3106 3047
query88 5514 2326 2330 2326
query89 516 369 380 369
query90 2456 179 178 178
query91 120 96 93 93
query92 54 46 47 46
query93 8044 498 491 491
query94 1578 180 176 176
query95 384 302 297 297
query96 622 256 253 253
query97 3142 2907 2939 2907
query98 229 218 214 214
query99 1163 882 883 882
Total cold run time: 313410 ms
Total hot run time: 186502 ms
TPC-H: Total hot run time: 41333 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0714adf798497cdb0b5ba52400564b367e49b9d7, data reload: false
------ Round 1 ----------------------------------
q1 17596 4326 4254 4254
q2 2014 178 185 178
q3 10473 1227 1252 1227
q4 10195 883 821 821
q5 7509 2718 2742 2718
q6 238 129 129 129
q7 1017 628 643 628
q8 9232 2150 2087 2087
q9 9881 6823 6726 6726
q10 9084 3897 3859 3859
q11 444 244 242 242
q12 421 227 224 224
q13 17331 3152 3222 3152
q14 283 226 240 226
q15 507 472 456 456
q16 473 403 396 396
q17 979 784 754 754
q18 8312 7767 7772 7767
q19 5268 1538 1518 1518
q20 1061 322 317 317
q21 5204 4120 3376 3376
q22 355 278 287 278
Total cold run time: 117877 ms
Total hot run time: 41333 ms
----- Round 2, with runtime_filter_mode=off -----
q1 4555 4360 4391 4360
q2 503 276 271 271
q3 3211 2977 2857 2857
q4 1877 1562 1583 1562
q5 5513 5516 5514 5514
q6 204 122 128 122
q7 2317 1972 2048 1972
q8 3261 3430 3370 3370
q9 8759 8839 8832 8832
q10 3984 3758 3834 3758
q11 596 497 495 495
q12 797 596 604 596
q13 16142 3161 3135 3135
q14 313 290 299 290
q15 532 484 485 484
q16 490 446 450 446
q17 1755 1497 1453 1453
q18 7615 7632 7325 7325
q19 1643 1505 1551 1505
q20 1999 1781 1756 1756
q21 9540 4761 4731 4731
q22 569 485 490 485
Total cold run time: 76175 ms
Total hot run time: 55319 ms
TPC-DS: Total hot run time: 186267 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0714adf798497cdb0b5ba52400564b367e49b9d7, data reload: false
query1 908 379 346 346
query2 6429 2233 2419 2233
query3 6645 201 208 201
query4 23240 21214 21253 21214
query5 4124 431 427 427
query6 267 168 167 167
query7 4583 297 287 287
query8 247 180 191 180
query9 8531 2400 2357 2357
query10 434 253 262 253
query11 14791 14173 14229 14173
query12 143 90 87 87
query13 1643 368 377 368
query14 9785 7529 7802 7529
query15 255 173 170 170
query16 8011 262 306 262
query17 1714 553 533 533
query18 2086 279 274 274
query19 212 151 150 150
query20 95 88 88 88
query21 196 122 124 122
query22 5030 4926 4856 4856
query23 33642 33101 33246 33101
query24 10732 2981 2944 2944
query25 571 369 366 366
query26 699 159 153 153
query27 2176 315 342 315
query28 5952 2038 2055 2038
query29 833 606 598 598
query30 247 162 156 156
query31 984 762 726 726
query32 85 51 56 51
query33 654 246 251 246
query34 914 481 494 481
query35 808 709 676 676
query36 1049 950 899 899
query37 104 68 67 67
query38 3174 3023 2983 2983
query39 1602 1539 1535 1535
query40 198 125 128 125
query41 42 39 40 39
query42 108 95 96 95
query43 590 512 554 512
query44 1114 721 741 721
query45 289 270 260 260
query46 1075 746 719 719
query47 1938 1829 1878 1829
query48 398 309 295 295
query49 826 401 405 401
query50 780 395 402 395
query51 6799 6677 6825 6677
query52 103 91 93 91
query53 343 285 284 284
query54 309 237 242 237
query55 83 72 74 72
query56 258 221 223 221
query57 1204 1148 1132 1132
query58 224 193 195 193
query59 3514 3221 3125 3125
query60 256 263 232 232
query61 96 87 85 85
query62 609 438 442 438
query63 306 287 283 283
query64 8162 7102 7088 7088
query65 3132 3030 3083 3030
query66 768 344 331 331
query67 15705 15345 15086 15086
query68 5174 561 546 546
query69 503 304 317 304
query70 1071 1060 1096 1060
query71 421 282 276 276
query72 7850 2600 2452 2452
query73 715 325 327 325
query74 6462 6021 6035 6021
query75 3461 2651 2683 2651
query76 3434 1007 1019 1007
query77 589 267 269 267
query78 11089 10187 10174 10174
query79 3869 551 540 540
query80 2158 439 434 434
query81 543 223 223 223
query82 1057 111 95 95
query83 309 176 169 169
query84 269 88 86 86
query85 1908 268 252 252
query86 483 300 320 300
query87 3287 3080 3058 3058
query88 4658 2415 2413 2413
query89 511 390 373 373
query90 2051 190 183 183
query91 128 96 99 96
query92 61 49 49 49
query93 5315 526 517 517
query94 1251 187 184 184
query95 394 311 304 304
query96 618 269 274 269
query97 3162 2965 2976 2965
query98 243 226 220 220
query99 1193 871 846 846
Total cold run time: 287061 ms
Total hot run time: 186267 ms
TeamCity be ut coverage result: Function Coverage: 35.59% (8928/25088) Line Coverage: 27.22% (73650/270537) Region Coverage: 26.42% (38055/144041) Branch Coverage: 23.21% (19404/83614) Coverage Report: http://coverage.selectdb-in.cc/coverage/0714adf798497cdb0b5ba52400564b367e49b9d7_0714adf798497cdb0b5ba52400564b367e49b9d7/report/index.html
TeamCity be ut coverage result: Function Coverage: 35.56% (8930/25115) Line Coverage: 27.21% (73701/270907) Region Coverage: 26.39% (38064/144214) Branch Coverage: 23.19% (19416/83714) Coverage Report: http://coverage.selectdb-in.cc/coverage/0714adf798497cdb0b5ba52400564b367e49b9d7_0714adf798497cdb0b5ba52400564b367e49b9d7/report/index.html
PR approved by at least one committer and no changes requested.
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}