Paul Gilzow

Didnt expect you to respond so fast! I'm out of town today but can try tomorrow. Thanks!

Thanks @Webslung . I'll add that the reference+test urls are pointed to the same domain, nothing changed code-wise between each test, and that the same tests _if run locally_ always...

> Just checking, are you comparing a docker-generated image with a local-generated image? No, the reference images are created in the same docker container as the test images, one right...

Also tried breaking the creation of the references and the tests into two stages+jobs in the gitlab pipeline. Meaning that gitlab will bring up the backstop docker container, run the...

@furai Thanks for sharing. I feel much better knowing it isn't just us.

> Does this still happen when you leave the reference url field empty (i.e. just use test url for all operations)? Haven't tried it that way. Let me remove the...

> Good that at lest it has fixed @gilzow issues. The tests pass, but this "fix" now requires that I use a set of scenarios for creating the reference and...

@garris looks like I spoke too soon. I went back and rewrote everything so we only use `url` and now the tests are failing _inconsistently_. Testing https://hes.missouri.edu/ against itself with...

I forgot to mention that if I run the same set up + scenarios _locally_ they pass every single run. > Oy. So, if you just run point to backstop.org,...

so far I haven't been able to get ``` { "label": "president", "url": "https://president.missouri.edu/" }, ``` To fail. > I might also need to see the logs for your runs....