katana
katana copied to clipboard
Create navigation module for headless crawler
- [ ] Handle generic prompts (popups, alerts, etc)
- [ ] Use go-rod to discover hooks and events and enqueue new discovered seed urls
- [ ] Detect and handle navigation loops/edge cases with circuit breaker mechanisms: timeouts, errors
Blocked by #75