(#2762, #2710) Update testing to include testing of stable Chocolatey builds
Description Of Changes
- Update the Vagrantfile used for running tests to be able to run tests against stable releases.
- Update Contributing.md to move testing section into Testing.md.
Motivation and Context
We need to ensure that newly added tests also succeed with currently stable versions of Chocolatey. If they do not, then they need to be gated on the Chocolatey version so that failing tests aren't accidentally introduced.
Testing
- Ran
vagrant up TestStablewhile this branch was based upon commit cce748 - Verified that tests failed
- Ran
vagrant up - Verified that tests passed
- Rebased branch off of current develop (136f1c)
- Ran
vagrant destroy -f - Ran
vagrant up TestStable - Verified that tests passed
- ran
vagrant up - verified that tests passed
Change Types Made
- [ ] Bug fix (non-breaking change)
- [x] Feature / Enhancement (non-breaking change)
- [ ] Breaking change (fix or feature that could cause existing functionality to change)
- [ ] PowerShell code changes.
Related Issue
Fixes #2762 Fixes #2710
Change Checklist
- [ ] Requires a change to the documentation
- [ ] Documentation has been updated
- [ ] Tests to cover my changes, have been added
- [ ] All new and existing tests passed.
- [ ] PowerShell v2 compatibility checked.
Coverage decreased (-0.05%) to 28.482% when pulling eeca4f3dd4cdd2803084838499b8221085ee0790 on corbob:test_stable into 136f1cb0f778d0e50e505b46177ccb97fb7543a9 on chocolatey:develop.
@corbob just wanted to check that you intended to close this PR, since the two linked issues are still open.
I was doing cleanup of my repositories last night, and either missed that this branch had a PR, or GitKraken didn't show it. In either case it was unintentional to close. I have closed one of the linked issues, as it's not actually needed due to process changes. I'll restore this branch to hopefully get back to updating the testing instructions.
@corbob thanks for getting this updated!