firecrawl icon indicating copy to clipboard operation
firecrawl copied to clipboard

[BUG] Can't access content in readme api documentation

Open calebpeffer opened this issue 9 months ago • 0 comments

Describe the Bug

Firecrawl fails to gather all the data available on documentation portals powered by Readme.

Specifically, its not getting information such as query parameters in code snippets

To Reproduce Just try scraping pages such as

Asana: https://developers.asana.com/reference/getworkspaces

Bamboo HR: https://documentation.bamboohr.com/reference/time-off-add-a-time-off-request-1

Breezy HR: https://developer.breezy.hr/reference/company-position-update

Ashby: https://developers.ashbyhq.com/reference/jobcreate

Expected Behavior This should gather the code, and other information in the sidebar.

Additional Context

I did some digging, and it seems like some of this data is available in the rawhtml.

image

But, its in a massive block of json, and is repeated over 296 times? Not really sure whats happening here:

image

Notify David Dalmaso in Slack and Aaron Tran via messenger when finished @calebpeffer

calebpeffer avatar May 25 '24 01:05 calebpeffer