browsertrix-crawler
browsertrix-crawler copied to clipboard
Load Custom Behaviour from URL
We'd like to be able to point to a URL that contains a javascript file that defines a custom behavior and have browsertrix-crawler be able to load and use that behavior.
Requirements
Be able to pass a URL to --customBehaviors flag which contains a single javascript file containing the custom behavior to be loaded and executed.
Future goals
Future goals could include passing an S3 directory, and have crawler be able to load all behaviors in that S3 bucket.