4cat

4cat copied to clipboard

Added Selenium URL scraper as new datasource; modified column filter to allow detailed matching information

3

- Added `selenium_scraper` as a new Search class to be used in creating new datasources. - Created `url_scraper` datasource which allows a user to scrape a list of urls and...

dale-wahl

Added an example yaml to make it work with docker swarm and reverse proxy traefik with ssl

5

Yaml for a docker swarm simple deployment, It is still can be corrected and added a few things, but I am sending the pull request for evaluation.

hydrosIII

Datasource that interfaces with a TCAT instance

6

It works, and arguably fixes #117, but: * The form looks hideous with the million query fields. Do we need them all for 4CAT? Is there a way to make...

stijn-uva

Telegram datasets return fewer results than ground truth for some accounts

1

The Telegram channel scraping function returns far fewer posts than the ground truth for some accounts, but all results for other accounts. One example where a hundreds of posts are...

schliebs

Flatten dictionaries function to better view ndjson data (preview, export as csv, `map_item`, etc.)

3

We've discussed doing this a bit offline. It could be useful to replace `map_item` or at least offer a different sort of preview of data and perhaps way to export...

dale-wahl

Tokeniser exclusion list ignores last word in list

4

I'm filtering some commonly used words out of a corpus with the Tokenise processor and it only seems to be partially successful. For example in one month there are 37,325...

robbydigital

Nothing interesting in the logs. Bad group code will report a 404 (`Got response code 404 for group 270401924. Continuing with next group...`), but good group code will show nothing....

dale-wahl

When using auto-login, there is no way to access admin features if you're automatically logged in, even if you have an admin account - because auto-login overrides all of that....

stijn-uva

It is now possible to tweak the 4CAT settings through the web interface, but this also makes it easier to break 4CAT by entering an invalid value, or by entering...

stijn-uva

Choose a consistent coding style

5

As more developers are contributing to 4CAT, the chance of mixing up different code styles increases and this can be inconvenient or confusing. I propose we adopt [Black](https://pypi.org/project/black/) for 4CAT,...

stijn-uva