ScrapeBot icon indicating copy to clipboard operation
ScrapeBot copied to clipboard

Using ScrapeBot without frontend

Open witb-world opened this issue 2 years ago • 1 comments

Hi there,

Does ScrapeBot support a way to load recipes without using the web frontend? Running scrapebot after installation gives me the following output:

ubuntu@<my-ec2-instance>:~/ScrapeBot$ python3 scrapebot.py
[2022-02-04 20:50:40.424729] ScrapeBot initiated (this is server time)
Configuration file "config.ini" found
Authenticated as instance "<my-instance-name>"
No (active) recipes found (actively) ascribed to this instance

To mark a recipe as active, does it need to be flagged somehow in config.ini? Should I keep the .sbj file in the recipes directory? Or is there a way to pass a recipe to the scrapebot.py script as an argument?

Thanks so much, really excited to start working with this tool.

witb-world avatar Feb 04 '22 20:02 witb-world

Recipes are managed within the database. No need for the web frontend. You can manage the database also directly (e.g., using phpmyadmin oder heidisql). Alternatively, have a look into ScrapeBotR which is an R package that lets you configure recipes and such.

MarHai avatar Feb 05 '22 12:02 MarHai