ail-framework

ail-framework copied to clipboard

Get a lot of "internal server error" recently

5

Please help. Cannot really pinpoint the exact problem.

certrik

Stuck Queue

7

Hi guys, I have a problem related to AIL queues. After some time, the framework starts to show stuck queue (e.g. Tags, Mail, Web etc...). I can't understand what's happening...

Gr3gbug

Bug: Non-standard Docker IP-ranges prohibit update via github

3

I had to change the docker standard IP-range (172.17. 0.0/16) to something different. In order to get the crawlers to work I had to modify `$AIL_HOME/configs/docker/splash_onion/etc/splash/proxy-profiles/default.ini` to fit the new...

certrik

TOR install fails on local

1

Ubuntu 20.04 clean install Running the crawler install is failing at the line below: ./crawler_hidden_services_install.sh: line 46: install_python_requirement: command not found ``` Setting up dnsmasq-base (2.80-1.1ubuntu1) ... Setting up ubuntu-fan...

syloktools

- [ ] Allow storage of dynamic configuration in the backend - [ ] New EXIF analyzer module to extract metadata and use it for correlation or leak hunting -...

adulau

AIL - New feeders

1

- [x] Certificate Transparency -> crawling new URL (first page) (maybe pre-filtering) - [ ] Grayhatwarfare - [x] Equaeris integration https://github.com/ail-project/equaeris - [x] GitHub stream feeder (source could be specific...

adulau

AIL - I2P crawling

1

- [ ] I2P address extraction (improve the onion address extractor too) - [ ] Improve I2P bootstrap address - [ ] Improve crawler for I2P (new proxy handle) -...

adulau

- [ ] Exposed the crawling part in the API

adulau

- [ ] Generic "dispatch" module to send item if a specific tag is set (based on rule) - [ ] The generic "dispatch" module should first support the ReST...

adulau

Feature request: Crawling telegram groups

4

It would be great if it was somehow possible to not only detect telegram groups (links) but to also be able to crawl them automatically. Most probably a telegram account...

certrik