flowfuse icon indicating copy to clipboard operation
flowfuse copied to clipboard

Run e2e tests locally without spinning smtp servers

Open cstns opened this issue 1 year ago • 3 comments

Description

add the ability to run e2e tests locally without spinning the docker smtp server processes

Related Issue(s)

Checklist

  • [x] I have read the contribution guidelines
  • [ ] Suitable unit/system level tests have been added and they pass
  • [ ] Documentation has been updated
    • [ ] Upgrade instructions
    • [ ] Configuration details
    • [ ] Concepts
  • [ ] Changes flowforge.yml?
    • [ ] Issue/PR raised on FlowFuse/helm to update ConfigMap Template
    • [ ] Issue/PR raised on FlowFuse/CloudProject to update values for Staging/Production

Labels

  • [ ] Includes a DB migration? -> add the area:migration label

cstns avatar Jul 09 '24 14:07 cstns

the only downside to this approach is that e2e tests that require the smtp server will always fail locally when running the cy:web-server-light script

cstns avatar Jul 09 '24 14:07 cstns

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 77.31%. Comparing base (fd4b836) to head (4ec8fe7). Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #4147   +/-   ##
=======================================
  Coverage   77.31%   77.31%           
=======================================
  Files         350      350           
  Lines       16583    16583           
  Branches     3865     3865           
=======================================
  Hits        12821    12821           
  Misses       3762     3762           
Flag Coverage Δ
backend 77.31% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • :package: JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

codecov[bot] avatar Jul 09 '24 14:07 codecov[bot]

the only downside to this approach is that e2e tests that require the smtp server will always fail locally when running the cy:web-server-light script

Could the same env var not be used to .skip the failing tests?

Steve-Mcl avatar Jul 10 '24 11:07 Steve-Mcl

closing, handled differently in https://github.com/FlowFuse/flowfuse/pull/5457

cstns avatar Apr 23 '25 16:04 cstns