browsertrix-crawler icon indicating copy to clipboard operation
browsertrix-crawler copied to clipboard

Load Custom Behaviour from URL

Open Chickensoupwithrice opened this issue 2 years ago • 0 comments

We'd like to be able to point to a URL that contains a javascript file that defines a custom behavior and have browsertrix-crawler be able to load and use that behavior.

Requirements

Be able to pass a URL to --customBehaviors flag which contains a single javascript file containing the custom behavior to be loaded and executed.

Future goals

Future goals could include passing an S3 directory, and have crawler be able to load all behaviors in that S3 bucket.

Chickensoupwithrice avatar Sep 06 '23 20:09 Chickensoupwithrice