unclecode
[Bug]: Help me to crawl all the links from Apple VisionOS Documentation? Vue Recycler
crawl4ai version
0.4.248
Expected Behavior
Starting link: https://developer.apple.com/documentation/visionos/
There are 66 total links. With all the documentation and LLMs, I couldn't get past 53 links. I've been at it for the past 3 days non-stop. It has something to do with a vue recycler. But I don't know how and if crawl4ai can bypass that.
Here's my current code: https://pastebin.com/MhN2uEWr
Im willing to pay at this point if someone can also teach me. Hope im not breaking any terms. Thx
Current Behavior
Crawler finds only 45 links out of 66
Is this reproducible?
Yes
Inputs Causing the Bug
Steps to Reproduce
Code snippets
OS
macos
Python version
3.11.9
Browser
No response
Browser version
No response
Error logs & Screenshots (if applicable)
No response
@dkampien The pastebin link is broken. Can you paste the code snippet here itself in issue description? Thanks
Closing this issue due to inactivity. Feel free to reopen this with answers to the queries posted above.