hoppscotch [feature]: Running tests with Hoppscotch CLI in order

[feature]: Running tests with Hoppscotch CLI in order

Open LuchoTurtle opened this issue 2 years ago • 2 comments

Is there an existing issue for this?

[X] I have searched the existing issues

Summary

Hey there, Hoppscotch team! 👋 Thanks for the amazing work put on so far!

I'm using the Hoppscotch CLI to run some tests in Github Actions (hopp test).

I've run hopp test quite a few times and the execution flow of each test seems to be absolutely random. Shouldn't the tests be running in the same order that they appear in the json file that is exported/in the GUI? This is a bit frustrating because some tests require the correct execution of others and having no control of the execution order is a bit underwhelming.

For example, I have three folders with several requests in each one:

The tests are executed in the order of Tags -> Timers -> Items. Inside each folder, the tests are run sequentially.

Is this behaviour intentional?

Why should this be worked on?

I believe the simplest solution would be running the tests in the same order they are displayed in the GUI/exported to the json file.

I think this is important for people who want to use this CLI to make API definition tests.

Feb 22 '23 15:02 LuchoTurtle

The issue is related to the collectionstack in hoppscotch-cli/src/utils/collections.ts. A stack is a last-in first-out collection. So, the last pushed folder is used as next step to do.