firecrawl
firecrawl copied to clipboard
[BUG] Crawl on single page works on playground but fails via curl
Describe the Bug For some odd reason, the using the crawl endpoint on this link https://www.tripadvisor.com/Restaurant_Review-g60763-d4418144-Reviews-Reichenbach_Hall-New_York_City_New_York.html returns a single page on the playground, but returns nothing via curl request
To Reproduce Steps to reproduce the issue:
- Run URL in Playground
- Run /crawl via curl then hit the /getCrawl endpoint with the returned ID
Expected Behavior This should return the content for a single page
Screenshots
The page working via playground:
The page failing via curl:
Additional Context Brought up by MN via email