Guilherme Gonçalves

Results 35 comments of Guilherme Gonçalves

I think there are two main sources of slowness here: - Missing database indexes for some important queries. - Accidental evaluation of Django QuerySets. We _attempt_ to use pagination for...

It looks like there's still some bad performance when querying for many hashtags at once ([example query](https://hashtags.wmflabs.org/graph/?query=WPWP%2C+WPWPRW%2C+WPWPRT%2C+WPWPUIL%2C+WPWPTH%2C+WPWPQS%2C+WPWPCA%2C+WPWPCM%2C+WPWPIN%2C+WPWPMK%2C+WPWPNG%2C+WPWPTR%2C+WPWPLV%2C+WPWPTZ%2C+WPWPZM%2C+WPWPPT%2C+WPWPBW%2C+WPWPML%2C+WPWPGN%2C+WPWPIT%2C+WPWPDZ%2C+WPWPHI%2C+WPWPSR%2C+WPWPWLF%2C+WPWPBE%2C+WPWPPH%2C+WPWPIG%2C+WLA%2C+WPWPCB%2C+WPWPTE%2C+WPWPMU%2C+WPWPSU%2C+WPWPDC%2C+WPWPUG%2C+WPWPAM%2C+WPWPWAM%2C+WPWPCH%2C+WPWPMIN%2C+WPWPUK%2C+WPWPARK%2C+WPWPBI%2C+WPWPTMZ%2C+WPWPGOA%2C+WPWPBN%2C+WPWPGC%2C+WPWPNL%2C+WPWPEO%2C+WPWPUAE%2C+WPWPWC%2C+WPWPIM%2C+WPWPUI%2C+WPWPVWW%2C+WPWPJV%2C+WPWPWD%2C+WPWPAR%2C+WPWPSUN%2C+WPWPIE%2CWPWPEG%2C+WPWPPK%2C+WWH%2C+WPWPHU%2C+WPWPW&project=&startdate=2021-07-01&enddate=2021-08-31&search_type=or&user=)). I need to check whether this is some other unoptimized code path, but...

Things are looking a little better now I think. I'm seeing [the test query](https://hashtags.wmflabs.org/graph/?query=WPWP%2C+WPWPRW%2C+WPWPRT%2C+WPWPUIL%2C+WPWPTH%2C+WPWPQS%2C+WPWPCA%2C+WPWPCM%2C+WPWPIN%2C+WPWPMK%2C+WPWPNG%2C+WPWPTR%2C+WPWPLV%2C+WPWPTZ%2C+WPWPZM%2C+WPWPPT%2C+WPWPBW%2C+WPWPML%2C+WPWPGN%2C+WPWPIT%2C+WPWPDZ%2C+WPWPHI%2C+WPWPSR%2C+WPWPWLF%2C+WPWPBE%2C+WPWPPH%2C+WPWPIG%2C+WLA%2C+WPWPCB%2C+WPWPTE%2C+WPWPMU%2C+WPWPSU%2C+WPWPDC%2C+WPWPUG%2C+WPWPAM%2C+WPWPWAM%2C+WPWPCH%2C+WPWPMIN%2C+WPWPUK%2C+WPWPARK%2C+WPWPBI%2C+WPWPTMZ%2C+WPWPGOA%2C+WPWPBN%2C+WPWPGC%2C+WPWPNL%2C+WPWPEO%2C+WPWPUAE%2C+WPWPWC%2C+WPWPIM%2C+WPWPUI%2C+WPWPVWW%2C+WPWPJV%2C+WPWPWD%2C+WPWPAR%2C+WPWPSUN%2C+WPWPIE%2CWPWPEG%2C+WPWPPK%2C+WWH%2C+WPWPHU%2C+WPWPW&project=&startdate=2021-07-01&enddate=2021-08-31&search_type=or&user=) load in around 20s, which is not great, but better than consisten 502s.

Thanks for the quick response! > I guess this issue is specifically referring to this FIXME: https://github.com/alexz-enwp/wikitools/blob/b71481796c350/wikitools/api.py#L309? Pretty much, though I'm also interested in raising exceptions without retrying for (presumably)...