ail-framework icon indicating copy to clipboard operation
ail-framework copied to clipboard

The built-in test fails when Tor is not usable despite web crawling being available

Open ajoga opened this issue 1 year ago • 4 comments

Summary

I understand Lacus can fetch content from both Tor websites and the normal internet.

An installation without configuring Tor will make the built-in test fail, when in reality web content can be fetched.

Step to reproduce

Follow the procedure from https://github.com/ail-project/ail-framework/blob/26f9e84d9796446cefa175eed78a0e89ebfda966/HOWTO.md#crawler

When running the test while you don't have a Tor socks listening, the test output will be the following: image

One can confirm the web crawling works:

  1. go to Manual crawler, set a public URL and crawler type = web.
  2. go to Web crawler and observe that the URL was crawled (allow 10-30 seconds if that doesn't show right away)

Expected outcome

I would expect not to have the "Error" in red after the test for sure.

Ideally two tests, one for Web and one for Tor: there it would make sense for me to see one pass and one fail. Currently it feels like the whole test was unsuccessful.

ajoga avatar Jul 22 '24 15:07 ajoga

I transferred this issue to AIL because I don't think it is related to lacus (?)

Rafiot avatar Jul 22 '24 17:07 Rafiot

Hey, I just looked at the error message again, and just making sure of one thing: is tor up and running on the machine where lacus is installed? Because the error messages makes me think lacus cannot connect to the proxy, possibly because it's not there.

Rafiot avatar Aug 23 '24 10:08 Rafiot

is tor up and running on the machine where lacus is installed

No it is not, by design in our case.

ajoga avatar Aug 23 '24 10:08 ajoga

Ok, I'll let @Terrtia take care of it then.

Rafiot avatar Aug 23 '24 11:08 Rafiot