Rafael Miller

Results 153 comments of Rafael Miller

Hey @snippet I just reviewed your PR and this feature is awesome (especially when used with `ignoreSitemap`), but I don't think it closes this issue because the problem here is...

@nickscamara I think we can close this one and #389 since we're not merging it into the main branch due to performance prioritization.

@theodufort could check what happens if you try using some fake api key? something like "fc-123"

@theodufort any updates on this one?

Closing for now. Feel free to reopen if you continue to experience this problem.

@nickscamara I'm not able to reproduce this. I tested with `https://www.lsu.edu/majors` for these parameters: | limit | returnOnlyUrls | Retrieved URLs | |---|---|---| | 0 | True | 0 |...

Found the bug: Previously, the `env.local` file had the variables set like this: ```env SCRAPING_BEE_API_KEY=# set if you'd like to use scraping Be to handle JS blocking ``` he issue...

This is solved in v1 with the next parameter on GET crawl. Closing for now. @EvanBoyle, feel free to reopen if v1 doesn’t resolve this.