Intellij-Plugin icon indicating copy to clipboard operation
Intellij-Plugin copied to clipboard

Integrate IntelliJ Test runner for spec execution

Open apoorvam opened this issue 8 years ago • 15 comments

With this feature, user can see scenario level execution in IntelliJ test runner, which adds better UI.

apoorvam avatar Feb 25 '16 12:02 apoorvam

We couldn't use GRPC with IntelliJ because of dependency conflict. Link to IntelliJ forum post.

kashishm avatar Aug 29 '17 03:08 kashishm

Available in IntelliJ plugin nightly >= 0.3.7.nightly-2017-08-30 and Gauge nightly >= 0.9.2.nightly-2017-08-29

kashishm avatar Aug 30 '17 05:08 kashishm

  • [x] Should be able to run tests in parallel
  • [x] Should be able to run a given scenario
  • [x] Should be able to run a given spec
  • [x] Should be able to run given tags
  • [x] Should be able to run previously failed tests
  • [x] Should be able to re-run tests
  • [x] Should be able to identify passed, failed and skipped tests
    • [x] When no specifications are found for execution. The test scenario status is ignored.
    • [x] Failure messages should be displayed.
  • [x] Should be able to run tests with table - issue
  • [x] Should be able to run tests without parse errors

sswaroopgupta avatar Aug 31 '17 05:08 sswaroopgupta

@sguptatw Unimplemented tests are ignored and not failed. And IntelliJ shows the ignored tests messages with blue color.

kashishm avatar Aug 31 '17 06:08 kashishm

@kashishm - Thanks for the clarifications. Couple of more suggestions updated in the comment above

sswaroopgupta avatar Aug 31 '17 06:08 sswaroopgupta

Keeping the console report and test runner consistent. Even in console report when a concept has a failure the specification file name is shown and not concept file name.

However showing the concept file name and line number is useful so tracking it here

BugDiver avatar Sep 04 '17 05:09 BugDiver

Line no in failure is shown only for steps, not for concepts. For concept failure, all reporters show only spec file name.

BugDiver avatar Sep 04 '17 11:09 BugDiver

screen shot 2017-09-06 at 4 37 27 pm

Even after the tests are executed the icon still shows wait

sswaroopgupta avatar Sep 06 '17 11:09 sswaroopgupta

A failed scenario icon is wrong. Even on clicking a failed scenario, I am not getting the failure details To replicate, run this project in the IDE specList.zip

screen shot 2017-09-06 at 4 41 46 pm

Version

Gauge version: 0.9.2.nightly-2017-08-31
Commit Hash: 954af9f

Plugins
-------
csharp (0.10.1)
html-report (4.0.2.nightly-2017-08-07)
java (0.6.5.nightly-2017-08-31)
ruby (0.4.1)
spectacle (0.1.2)
xml-report (0.2.0)

IDE - Version: 0.3.7.nightly-2017-09-04

sswaroopgupta avatar Sep 06 '17 11:09 sswaroopgupta

  • [x] icons - fixed with 0.9.2.nightly-2017-09-06
  • [x] Unimplemented test is shown as failed instead of skipped

sswaroopgupta avatar Sep 06 '17 12:09 sswaroopgupta

@sguptatw Cannot replicate Unimplemented test is shown as failed instead of skipped. Please upload the sample project where it is replicable.

kashishm avatar Sep 11 '17 09:09 kashishm

@kashishm Any step which is unimplemented has the following message screen shot 2017-09-11 at 3 02 34 pm

The issue is that this step is shown as Failed. However it is actually skipped. Can we change the wordings accordingly.

sswaroopgupta avatar Sep 11 '17 09:09 sswaroopgupta

@sguptatw @kashishm I can replicate it and I've done the fix as well just forgot to push.

BugDiver avatar Sep 11 '17 09:09 BugDiver

Fix will be available in nightly >= 0.3.7.nightly-2017-09-11

kashishm avatar Sep 14 '17 05:09 kashishm

  • [x] Getting runtime exception while executing specs - getgauge/gauge#808
  • [ ] The failure message should list the line number as well - https://github.com/getgauge/Intellij-Plugin/issues/296
  • [ ] If a concept has a validation error, the concept file name and line number should be displayed - not the specification name - https://github.com/getgauge/Intellij-Plugin/issues/297
  • [ ] If concept has issue, the concept details should be displayed. https://github.com/getgauge/gauge/issues/816

sswaroopgupta avatar Sep 14 '17 06:09 sswaroopgupta