[EXPERIMENTAL] Autogenerated unittests - evaluating usability

[JanKrivanek]

Context

Generated with very early preview of unit tests generation tool. Trying to evaluate if there is any hope of that being useful and what would need to be worked on to achieve usefulness.

Technical data

Baseline (main):

Test summary: total: 85, failed: 3, succeeded: 81, skipped: 1, duration: 6.9s

Target (generated):

Test summary: total: 690, failed: 56, succeeded: 634, skipped: 0, duration: 6.0s

AssemblyName	LineRateBefore	LineRateAfter	LineRateDiff	BranchRateBefore	BranchRateAfter	BranchRateDiff
StructuredLogger	19.61 %	26.72 %	7.11 %	15.69 %	18.63 %	2.93 %
StructuredLogger.Utils	0.00 %	9.47 %	9.47 %	0.00 %	3.75 %	3.75 %

More comments

• Still just heuristical version (so might not follow convention and references of the repo)
• Very few and dummy code fixers - so we fallback a lot to commenting out tests with compilation diagnostic
• No runtime feedback yet - so tests that crash/fail during runtime are kept

[Janek91]

@JanKrivanek How did you generate these tests?

[JanKrivanek]

@JanKrivanek How did you generate these tests?

@Janek91 - Research project :-)