get-site-urls icon indicating copy to clipboard operation
get-site-urls copied to clipboard
verified publisher icon alex-page

Add support for client-side rendered sites

Open aaronccasanova opened this issue 2 years ago • 0 comments

  • Fixed failures in test run-script
  • Updated the CLI to use getSiteUrls
    • Important: This included the following BREAKING CHANGES
    • Replaced spinner option in crawUrls with a generic logger callback
    • Moved maxDepth into a config object in getSiteUrls
  • Added puppeteer to extract client-side rendered HTML

Before:

Screenshot 2023-07-29 at 11 03 21 AM

After:

Screenshot 2023-07-29 at 11 02 24 AM

aaronccasanova avatar Jul 29 '23 18:07 aaronccasanova