nodejs-itoolkit icon indicating copy to clipboard operation
nodejs-itoolkit copied to clipboard

test: Set per-test expected duration

Open abmusse opened this issue 4 years ago • 1 comments

Calculated the expected test duration by running each test case 5 times and computing the average run time.

Functional Tests

Ran using ssh transport to connect from local machine to remote IBM i machine.

Test Time (ms) Time (ms) Time (ms) Time (ms) Time (ms) Average
CL command tests 2426 1740 1722 1671 1642 1840.2
SH command tests 3318 2949 2827 3104 2725 2984.6
QSH command tests 3611 3366 3496 3022 3004 3299.8
sendToDataQueue 1491 1361 1434 1353 1343 1396.4
receiveFromDataQueue 1447 1343 1377 1440 1333 1388
clearDataQueue 1474 1373 1361 1428 1441 1415.4
getTCPIPAttr 2278 1519 1484 1488 1421 1638
getNetInterfaceData 1930 1458 1403 1400 1356 1509.4
retrUsrAuth 1511 1489 1601 1459 1515 1515
rtrCmdInfo 1806 1346 1495 1417 1347 1482.2
retrPgmInfo 3911 1326 1416 1327 1365 1869
retrSrvPgmInfo 1893 1335 1466 1354 1317 1473
retrUserInfo 1431 1353 1468 1322 1315 1377.8
retrUsrAuthToObj 1350 1368 1378 1294 1340 1346
addToLibraryList 1385 1334 1335 1342 1301 1339.4
getPTFInfo 1731 1478 1382 1439 1471 1500.2
getProductInfo 1318 1344 1329 1357 1329 1335.4
getInstalledProducts 2549 2473 2423 2492 2485 2484.4
prepare & execute 3810 1695 1697 1808 1682 2138.4
addQuery & fetch 2515 1688 1553 1605 1524 1777
ensure issue #11 was resolved 1716 1552 1557 1579 1555 1591.8
tables 3345 1712 1618 1999 1506 2036
tablePriv 2681 1549 1576 1807 1548 1832.2
columns 2965 1559 1634 1617 1567 1868.4
columnPriv 3722 1922 1575 1640 1521 2076
procedures 2174 1521 1544 1719 1506 1692.8
pColumns 2620 1544 1577 1662 1613 1803.2
primaryKeys 2718 3105 1530 1566 1516 2087
foreignKeys 2480 2870 1562 1593 1591 2019.2
statistics 4086 1996 1912 2229 1726 2389.8
special skip skip skip skip skip skip
rowCount skip skip skip skip skip skip
createUserSpace 1543 1443 1422 1448 1435 1458.2
setUserSpaceData 1359 1367 1334 1327 1364 1350.2
getUserSpaceData 1337 1289 1304 1316 1363 1321.8
deleteUserSpace 1313 1350 1339 1319 1317 1327.6
getSysValue 1333 1520 1366 1370 1418 1401.4
getSysStatus 3032 1430 1340 1367 1591 1752
getSysStatusExt 2405 2399 2410 2404 2419 2407.4
getJobStatus 1351 1298 1332 1320 1343 1328.8
getJobInfo 1317 1287 1331 1299 1341 1315
getDataArea 1309 1322 1347 1306 1350 1326.8
addParam 1372 1431 1416 1369 1411 1399.8
addReturn skip skip skip skip skip skip

Deprecated functional tests

Ran using HTTP transport to connect from local machine to remote IBM i machine.

Test Time (ms) Time (ms) Time (ms) Time (ms) Time (ms) Average
iCmd() 595 559 680 464 510 561.6
iSh() 1762 1775 1730 1708 1649 1724.8
iQsh() 3299 3626 2973 3414 2297 3121.8
iDataQueue Constructor 1 1 1 2 1 1.2
sendToDataQueue 364 380 358 312 328 348.4
receiveFromDataQueue 394 404 365 304 313 356
clearDataQueue 405 446 318 319 311 359.8
iNetwork Constructor 1 1 1 1 2 1.2
getTCPIPAttr 600 356 395 328 357 407.2
getNetInterfaceData 356 549 390 373 358 405.2
iObj Constructor 1 1 1 1 1 1
retrUsrAuth 323 318 335 330 322 325.6
rtrCmdInfo 319 335 316 316 313 319.8
retrPgmInfo 473 326 320 323 345 357.4
retrSrvPgmInfo 462 324 307 306 316 343
retrUserInfo 525 321 300 320 316 356.4
retrUsrAuthToObj 329 353 312 328 297 323.8
addToLibraryList 324 317 332 307 304 316.8
iProd Constructor 1 1 1 1 1 1
getPTFInfo 385 330 361 336 329 348.2
getProductInfo 325 337 319 302 306 317.8
getInstalledProducts 2686 1607 1520 1582 1522 1783.4
prepare & execute 1183 604 576 519 542 684.8
addQuery & fetch 470 475 485 449 435 462.8
ensure issue #11 was resolved 1033 471 470 459 445 575.6
tables 537 475 457 456 460 477
tablePriv 497 493 479 521 456 489.2
columns 510 529 523 518 513 518.6
columnPriv 472 498 483 460 466 475.8
procedures 471 480 464 455 501 474.2
pColumns 484 491 479 476 493 484.6
primaryKeys 498 467 461 466 450 468.4
foreignKeys 479 466 471 462 458 467.2
statistics 1259 765 759 728 729 848
special skip skip skip skip skip skip
rowCount skip skip skip skip skip skip
iUserSpace Constructor 1 1 1 2 2 1.4
createUserSpace 338 341 343 378 353 350.6
setUserSpaceData 298 322 313 323 324 316
getUserSpaceData 311 334 332 301 301 315.8
deleteUserSpace 305 302 337 302 323 313.8
iWork Constructor 1 2 1 1 1 1.2
getSysValue 328 330 325 325 323 326.2
getSysStatus 534 339 338 313 337 372.2
getSysStatusExt 1397 1410 1404 1421 1462 1418.8
getJobStatus 303 303 319 323 314 312.4
getJobInfo 349 313 311 315 327 323
getDataArea 438 314 307 319 303 336.2
addParam 324 320 331 368 334 335.4
addReturn skip skip skip skip skip skip

Unit Tests

Test Time (ms) Time (ms) Time (ms) Time (ms) Time (ms) Average
SH command tests 1 3 3 3 3 3 3
SH command tests 2 0 1 0 0 0 0.2
CL command tests 1 1 0 0 0 0 0.2
CL command tests 2 0 0 0 0 0 0
QSH command tests 1 0 0 1 0 0 0.2
QSH command tests 2 0 0 0 0 0 0
Connection Constructor 1 4 5 4 4 5 4.4
Connection Constructor 2 1 4 1 0 4 2
add 1 1 0 1 1 0.8
debug 0 0 0 0 0 0
getTrasportOptions 0 0 1 0 0 0.2
run 2 2 3 2 3 2.4
ProgramCall Constructor 3 3 3 3 3 3
toXML 0 0 0 0 1 0.2
addParam 1 1 0 1 1 1 0.8
AddParam 2 1 0 0 0 1 0.4
AddParam 3 0 1 0 0 0 0.2
AddParam 4 0 0 0 1 0 0.2
AddParam 5 0 1 0 0 0 0.2
AddParam 6 0 0 0 1 0 0.2
AddReturn 1 0 1 0 0 0 0.2
AddReturn 2 0 0 0 0 0 0

Deprecated Unit Tests

Test Time (ms) Time (ms) Time (ms) Time (ms) Time (ms) Average
iSh function 1 4 4 4 4 4 4
iSh function 2 1 1 0 1 1 0.8
iCmd function 1 0 0 0 1 1 0.4
iCmd function 2 0 1 1 0 0 0.4
iQsh function 1 0 0 1 0 0 0.2
iQsh function 2 1 0 0 1 1 0.6
iConn Constructor 1 5 4 4 4 5 4.4
iConn Constructor 2 1 1 1 2 1 1.2
add 0 1 1 0 1 0.6
debug 1 1 1 1 1 1
getTrasportOptions 1 1 1 1 0 0.8
run 2 3 3 2 2 2.4
iSql constructor 3 3 3 5 3 3.4
toXML 0 1 1 1 0 0.6
addQuery 1 1 0 1 0 0 0.4
addQuery 2 0 0 1 0 1 0.4
fetch 1 1 1 1 1 0 0.8
fetch 2 0 0 0 0 0 0
fetch 3 0 0 1 0 0 0.2
fetch 4 0 0 0 0 0 0
commit 1 0 1 0 0 1 0.4
commit 2 0 0 0 1 0 0.2
commit 3 0 0 1 0 1 0.4
commit 4 0 0 0 1 0 0.2
prepare 1 0 1 1 0 1 0.6
prepare 2 0 0 1 0 0 0.2
execute 1 0 1 0 0 1 0.4
execute 2 0 0 1 0 0 0.2
execute 3 0 0 0 0 1 0.2
execute 4 0 0 0 0 0 0
tables 1 0 1 1 1 1 0.8
tables 2 0 0 0 0 0 0
tablePriv 1 0 1 0 1 1 0.6
tablePriv 2 0 0 1 0 0 0.2
columns 1 0 1 0 0 1 0.4
columns 2 0 0 0 0 0 0
columnPriv 1 0 1 1 0 0 0.4
columnPriv 2 1 0 0 0 0 0.2
procedures 1 0 1 0 0 0 0.2
procedures 2 1 0 0 1 0 0.4
pColumns 1 0 0 1 0 0 0.2
PColumns 2 1 0 0 0 0 0.2
primaryKeys 1 0 0 0 0 0 0
primaryKeys 2 1 0 1 0 0 0.4
foreignKeys 1 0 0 0 1 0 0.2
foreignKeys 2 1 0 0 0 1 0.4
statistics 1 0 0 0 1 0 0.2
statistics 2 0 0 1 0 1 0.4
special 1 0 0 1 0 0 0.2
special 2 0 0 1 0 1 0.4
count 1 0 0 0 0 0 0
count 2 0 0 0 0 1 0.2
count 3 0 0 1 0 0 0.2
rowCount 1 0 0 1 1 1 0.6
rowCount 2 0 0 0 0 0 0
free 0 0 0 1 1 0.4
describe 1 0 0 0 0 0 0
describe 2 0 0 0 0 1 0.2
describe 3 0 0 0 0 0 0
iPgm Constructor 3 3 4 4 4 3.6
toXML 2 1 1 1 1 1.2
addParam 1 2 2 2 2 2 2
addParam 2 1 1 1 1 1 1
addParam 3 0 1 1 1 1 0.8
addParam 4 0 1 0 1 0 0.4
addParam 5 1 1 0 1 0 0.6
addReturn 0 1 0 1 0 0.4
xmlToJson Tests 1 36 12 13 13 18.5
xmlToJson Tests 2 2 2 1 1 1.5
xmlToJson Tests 3 1 1 1 0 0.75
xmlToJson Tests 4 4 4 4 4 4
xmlToJson Tests 5 49 6 5 5 16.25

abmusse avatar Jul 15 '20 01:07 abmusse