botasaurus
botasaurus copied to clipboard
Feature requests with regards to file writes
Hi there,
Firstly, thank you for creating this greatly helpful anti detect browser.
I have small 2 feature requests that would help my usage of the service:
-
Ability to disable all file writes or specify target dir. This would be beneficial to run botasaurus in environments that are ephemeral and / or where our program does not have write general level permissions.
-
Ability to specific error_log dir name in each scrape function in the browser decorator or other config level for each script or parser would be greatly helpful as it would save time while trying to find the directory with the error log that we're trying to fix. When running multiple parsers for very long the error log dirs stack up really fast and once they're in the hundreds it takes a while to find the correct one. It would be helpful to be able to segregate them by file or script.
Thanks for reading. Wish you a pleasant day.
#1 Done #2 I am going to add feautre to keep atmost 10 logs, to prevent stack up issue.