corral icon indicating copy to clipboard operation
corral copied to clipboard

Replace tests that evaluate stdout output

Open hasheddan opened this issue 5 years ago • 5 comments
trafficstars

Some of the integration tests evaluate that certain words are present in the stdout output, which can break or change with updates to the logging verbosity. The following tests specifically do this:

integration/update/empty-deps                                                                                                                                                     
integration/update/github-leaf                                                                                                                                                                 
integration/fetch/empty-deps
integration/fetch/local-direct
integration/fetch/mutually-recursive
integration/fetch/self-referential
integration/fetch/local-git                                                                                                                                                                       
integration/fetch/github-deep                                                                                                                                                                  
integration/fetch/remote-gits
integration/help
integration/info
integration/run
integration/run/without-bundle
integration/version

See #137 for more information.

@SeanTAllen would you like for these checks to just be removed from all of these tests? In help / info / version we would essentially just be testing exit 0.

hasheddan avatar Jun 15 '20 00:06 hasheddan

I'd like to replace the tests that are using output to determine if an action happened with creating tests that use test-doubles to verify the correction interactions like for example, these that I recently wrote:

https://github.com/ponylang/corral/pull/132/files https://github.com/ponylang/corral/pull/134/files

SeanTAllen avatar Jun 15 '20 01:06 SeanTAllen

Did some work on this today, learned a bunch from this commit (https://github.com/ponylang/corral/commit/7f00b2ba4fd20fdf56b305f616967654b4f821e5). Hoping to have some updates landing soon :+1:

hasheddan avatar Jun 16 '20 01:06 hasheddan

@hasheddan are you interested in working on this? if yes, i can add you as a "contributor" to the ponylang org which basically allows you to be assigned to issues and not much else, then I can assign you to this.

SeanTAllen avatar Jun 16 '20 18:06 SeanTAllen

@SeanTAllen Definitely! Thanks :+1:

hasheddan avatar Jun 16 '20 18:06 hasheddan

ok @hasheddan once you accept the invite, you should be able to assign yourself as you will have "triage" level access to all the organization repos.

SeanTAllen avatar Jun 16 '20 19:06 SeanTAllen