UrlChecker icon indicating copy to clipboard operation
UrlChecker copied to clipboard

Automatically apply log for online only modules

Open PabloOQ opened this issue 2 years ago • 2 comments

Describe a related problem (optional)

Sometimes I need to come back to an URL I have checked before. If using any modules that make internet requests I need to wait for the answer, which depending on the page could take a "long" time.

Describe your suggested feature

Keep a log with the results of successful requests to the internet to later automatically apply if the same request is done.

Modules that currently need to make internet connections:

  • Status code
  • Unshortener
  • URL Scanner

This would be great to save time, bandwith and avoid potential tracking measures.

Describe alternatives you've considered for your suggested feature

No response

Other details

Downsides: If the answer changes there would be no way to know it, but I suspect this is unlikely, at least with the current modules. Anyway, worst cases I can think of:

  • A URL could randomly redirect the user to different sites, if the URL is cached it will no longer work, although this already doesn't work with Unshortener, as it only checks the URL once and then it stores it in the database.
  • Don't know exactly how VirusTotal flags bad URLs, but assuming it's always up to date, if a page is compromised then the report could be outdated.

Acknowledgements

  • [X] I have searched the existing issues and this is a new ticket, NOT a duplicate or related to another open issue.
  • [X] I have written a short but informative title.
  • [X] I will fill out all of the requested information in this form.

PabloOQ avatar Feb 16 '23 23:02 PabloOQ

Oh, it seems I never answered. Caching is a hard problem in the computer world, but it's true that it would be a really useful addition. Maybe not for VirusTotal (the scan should be recent) but for the Unshortener (which they do the caching anyway). I wonder if the Log module can be repurposed to show checked links after the current one... that way the user knows exactly that the 'following urls' come from previous checks inside the app.

TrianguloY avatar Feb 25 '23 12:02 TrianguloY

Seems like that is definitely something the Log module could have, but that means that "fast forwarding" would be limited to the log module itself.

PabloOQ avatar Mar 01 '23 23:03 PabloOQ