Technology detection failures

[max-ostapenko]

During the crawl no technology detected for 2% out of top 10000 pages. Running detection on my laptop is successful.

SELECT
  page,
  rank
FROM `httparchive.all.pages`
WHERE date = "2024-09-01"
  AND is_root_page
  AND client = 'mobile'
  AND rank <= 10000
  AND ARRAY_LENGTH(technologies)=0
ORDER BY rank, page

Tried to retest it on WPT:

• https://webpagetest.httparchive.org/result/240924_GA_7/ https://befonts.com/
• https://webpagetest.httparchive.org/result/240924_V9_8/ https://raksul.com/
• https://webpagetest.httparchive.org/result/240924_T7_9/ https://www.cnn.com/

WPT testing lasted really long (10-20min) and nothing detected again. Pages loaded slow too (up to 100s). Seems like a performance issue.

@pmeenan is it possible to investigate these?