gtfs-validator icon indicating copy to clipboard operation
gtfs-validator copied to clipboard

Acceptance test optimization

Open emmambd opened this issue 11 months ago • 1 comments

We want to make this process less time-intensive. Suggestions so far:

  • Better document filtering
  • Add performance analysis to the acceptance tests so we catch code changes with memory issues
  • Remove auto-run acceptance tests in draft mode
  • Reuse acceptance test reports when possible. Make sure if the master artifacts are +30 days we run the validator.

emmambd avatar Mar 08 '24 15:03 emmambd

Timebox: 3 days

davidgamez avatar May 13 '24 15:05 davidgamez

@cka-y An out of scope question but asking since it's coming up as I'm reviewing Flex feeds: the performance test is about the amount of time it takes to parse a feed, correct? I'm wondering as well about getting stats on the number of feeds that have unparsable rows grouped by file

emmambd avatar May 23 '24 18:05 emmambd

@emmambd -- It's about the amount of time it takes to validate the feed including parsing time. We could look into adding stats aboute the number of feeds with unparsable errors -- shall we open an issue for that?

cka-y avatar May 27 '24 14:05 cka-y

@cka-y Can do :) Out of scope for this iteration

emmambd avatar May 27 '24 15:05 emmambd