apm-server icon indicating copy to clipboard operation
apm-server copied to clipboard

APM Server 8.14.0 Test Plan

Open endorama opened this issue 1 year ago • 6 comments

Manual Test Plan

When picking up a test case, please add your name to this overview beforehand and tick the checkbox when finished. Testing can be started when the first build candidate (BC) is available in the CFT region.

Smoke Testing ESS setup

Thanks to https://github.com/elastic/apm-server/issues/8303 further smoke tests are run automatically on ESS now. Consider extending the smoke tests to include more test cases which we'd like to cover

Test cases from the GitHub board

apm-server 8.14 test-plan

Add yourself as assignee on the PR before you start testing.

  • [ ] https://github.com/elastic/apm-server/pull/12759

Regressions

Link any regressions to this issue.

endorama avatar Apr 17 '24 13:04 endorama

There is a changelog entry, added to 8.13 https://github.com/elastic/apm-server/commit/c706600c41ad97dcda450bf4a6433b7fbf8321c4 that looks like should target 8.14, I'll gather further information and report back.

The commit with the changes was merged in 8.13.0 so I think the changelog is fine: https://github.com/elastic/apm-server/commit/0062c137c1fbee5e6a75d27fe151b9e8538e5d8c

kruskall avatar Apr 17 '24 13:04 kruskall

https://github.com/elastic/go-docappender/pull/137

I think we can skip this one because per-document retries are not enabled in apm-server.

kruskall avatar Apr 17 '24 13:04 kruskall

BC 3 is out on May 2nd and there is only 1 BC after that before 8.14 being released!

endorama avatar Apr 29 '24 08:04 endorama

Removing dependencies bumps from the test plan

endorama avatar Apr 30 '24 13:04 endorama

Removing dependencies bumps from the test plan

Have you verified that they didn't pull in any changes that require manual testing?

simitt avatar May 01 '24 09:05 simitt

@simitt there has been some internal discussion around testing those issues and the conclusion (from Andrew and Vishal) has been that we cannot test them beyond what the smoke test would be doing.

After reviewing them I agree, they are code changes that do not have a defined manual test plan but rely on our automated test suite.

endorama avatar May 02 '24 14:05 endorama

I tested today the only issue in the test plan (thanks @carsonip for you guidance!). That makes for the completion of our 8.14 test plan :tada: Closing.

endorama avatar May 13 '24 10:05 endorama