[email protected]: timeout while reading page's body

[bassosimone]

See this measurement where everything is fine except that we time out while reading the response body. Perhaps, we should use a better strategy here by which we consider a timeout reading the body in a more graceful way than failing the response.

[arky]

This results in false positive 'anomaly' on multiple websites. Preventing such false positives would improve usability of ooni measurements.

[bassosimone]

@arky https://github.com/ooni/probe-cli/pull/959 should have fixed the issue. I could not reproduce the original problem but I simulated a similar problem. I inflated the max body snapshot size to 1<<29 (with a separate patch) and measured a URL containing 5g of data while using my mobile phone as a router. The experiment terminated after a 10 s download and a few megabytes downloaded. The resulting measurement contained no error and a base64 encoded body.