chef-workstation icon indicating copy to clipboard operation
chef-workstation copied to clipboard

Extend Umbrella framework for end-to-end testing

Open vkarve-chef opened this issue 2 years ago • 1 comments

More frequent and reliable Chef Workstation releases require baseline automated e2e testing that is integrated into CI/CD pipeline. Some other products such as Supermarket and Automate have already utilised the Umbrella test framework for this purpose.

The goals of this initiative include

  • Identifying a small set of use-cases / scenarios where e2e test automation has maximum benefit
  • Study and experiment with the Umbrella framework
  • Effort estimate for automating the specific use-cases / scenarios
  • Iteratively automate the use-cases identified above

vkarve-chef avatar Dec 14 '21 10:12 vkarve-chef

Effort estimate for automating the can be estimated to 8 or more

we can consider the following commands for use-cases/scenarios

  • chef-ci:
  1. chef install/ update/ push
  • knife:
  1. knife bootstrap
  2. knife user( create, key create)
  3. knife cookbook (download, list, upload)
  4. knife data_bag (create, show, from file)
  5. knife upload
  6. knife environment (create, list)
  7. knife node (create, list, run_list set, show)
  8. knife ssh
  9. knife search
  • kitchen:
  1. kitchen-azurerm
  2. kitchen-google
  3. kitchen-ec2
  4. kitchen-vagrant
  5. kitchen-dokken and to run kitchen test on each so that covers all of creation...converge..destroy

snehaldwivedi avatar Feb 16 '22 11:02 snehaldwivedi