devops-course
devops-course copied to clipboard
KTH
Testing, verification and test automation
Wikipedia references:
- https://en.wikipedia.org/wiki/Software_testing
- https://en.wikipedia.org/wiki/Unit_testing
- https://en.wikipedia.org/wiki/Regression_testing
- https://en.wikipedia.org/wiki/Code_coverage
"Automated testing is the act of conducting specific tests via automation (e.g. a set of regression tests) as opposed to conducting them manually, while test automation refers to automating the process of tracking and managing the different tests." source
Interesting tool. Detailed failure reports and hassle free assertions Scott test reporter https://github.com/dodie/scott
From @AG00:
There is a relationship between desired properties (requirements), tests (verification) and test results. Those may be present in a hierarchy of components/subsystems/libraries. In addition, there is a relationship between planning activities on the system (product) being developed and its desired properties. Further, with time there will be more than one system/product configuration to consider and more than one version in use with different installations/deployments/customers. These relationships quickly becomes complex to understand and keep track of. As changes are being made (code or documents) and automatic tests are run, it would be good to have the information model changes generated rather than manually written. The information model can also be used to convince a customer (or the devops team itself) that a complex/high-level system property is achieved.
Testcontainers to test different environments on the developer's machine https://www.testcontainers.org/
A post about the challenges to get global metrics for code coverage https://massol.myxwiki.org/xwiki/bin/view/Blog/GlobalLocalCoverage
DeFlaker: Automatically Detecting Flaky Tests https://www.jonbell.net/icse18-deflaker.pdf
Property-based testing in Java https://github.com/quicktheories/QuickTheories
Cross Browser Testing, Selenium Testing, and Mobile Testing https://saucelabs.com/
Capturing test history https://stackoverflow.com/questions/37657130/how-to-capture-the-junit-test-result-of-project-in-database
Automated Tool for Prioritizing JUnit Test Suites https://github.com/kanonizo/kanonizo
automatic unit test amplification https://github.com/STAMP-project/dspot https://arxiv.org/pdf/1811.08330.pdf
automatic detection of pseudo-tested methods https://github.com/STAMP-project/pitest-descartes https://arxiv.org/pdf/1807.05030.pdf
Property-based testing in OCaml https://github.com/c-cube/qcheck
@robertfeldt you may want to subscribe to this issue.
Chris Parnin's Lecture on software bots https://docs.google.com/presentation/d/1JClXhqNX8ufzmxoDpVPCLRDlqu4tUkvbJgwYICw70kM/edit?usp=sharing
Testing of Microservices
https://labs.spotify.com/2018/01/11/testing-of-microservices/
Amazon codeguru It’s like having a distinguished engineer on call, 24x7 https://aws.amazon.com/codeguru/
Rultor is a DevOps team assistant. It helps your programmers and release managers automate routine operations (merge, deploy and release), with an easy-to-use intuitive chatbot interface. https://github.com/yegor256/rultor
A series of recent posts about test and automation http://blog.testingcurator.com/2020/04/12/testing-bits-april-5th-april-11th-2020/
Jasmine is a behavior-driven development framework for testing JavaScript code. https://jasmine.github.io/
Catch2: modern, C++-native, header-only, test framework for unit-tests, TDD and BDD - using C++ https://github.com/catchorg/Catch2
Commonly used test data https://github.com/search?p=2&q=dQw4w9WgXcQ&type=Code
Commercial product to accelerate tests with an automated dependency graph https://yourbase.io/
Automated Cucumber-JVM test pack for DECS built on the Serenity BDD framework https://github.com/UKHomeOffice/hocs-serenity-automation
Testing at Electronic Arts SUPERNOVA: Automating Test Selection and Defect Prevention in AAA Video Games Using Risk Based Testing and Machine Learning https://arxiv.org/pdf/2203.05566.pdf