Telemetry: UI & Test Usage

[TheBrunoLopes]

UI specific metrics

• H: Get number of unique active users. Being done in https://github.com/kubeshop/testkube/issues/2069 ✅
• L: Average time on the following pages: Test & Suite List ; Test & Test suite page. Test/suite settings.
• L: Nº of actions:
  • Create Test
  • Create Testsuite
  • Run TestSuite
  • Run Test

Test runs:

• H: Nº Test executions.

  • Get the type of test (cypress,k6,postman, etc...)
  • Duration
  • Data around resource usage: CPU, Memory, storage, etc...
  • Visualization:

• H: Nº of Test Suite runs:

  • Visualization:

• M: Nº of Test Creations (add test type and source type)

• M: Nº of Test Suite creations

- Notes

• all metrics should have daily & weekly views/calculations.
• priority levels: H > M > L (lets focus on the H first)

[TheBrunoLopes]

AC: Complete the backend issue that adds an api endpoint to disable telemetry.

[vsukhin]

From what I understood there, we will need send these 4 events for telemetry collection. And then based on this data UI will be used to prepare reports

[exu]

@vsukhin yes, just pass different event type, segment will create automatically new table for that events.

[vsukhin]

@TheBrunoLopes all 4 events were added and sent to segment.io. We need to create related reports there. I don't have access to segment.io myself