ScrapeBot
ScrapeBot copied to clipboard
Using ScrapeBot without frontend
Hi there,
Does ScrapeBot support a way to load recipes without using the web frontend? Running scrapebot after installation gives me the following output:
ubuntu@<my-ec2-instance>:~/ScrapeBot$ python3 scrapebot.py
[2022-02-04 20:50:40.424729] ScrapeBot initiated (this is server time)
Configuration file "config.ini" found
Authenticated as instance "<my-instance-name>"
No (active) recipes found (actively) ascribed to this instance
To mark a recipe as active, does it need to be flagged somehow in config.ini
? Should I keep the .sbj
file in the recipes
directory? Or is there a way to pass a recipe to the scrapebot.py script as an argument?
Thanks so much, really excited to start working with this tool.
Recipes are managed within the database. No need for the web frontend. You can manage the database also directly (e.g., using phpmyadmin oder heidisql). Alternatively, have a look into ScrapeBotR which is an R package that lets you configure recipes and such.