PulsarRPA icon indicating copy to clipboard operation
PulsarRPA copied to clipboard

Properly handle 404 Not Found pages

Open platonai opened this issue 1 year ago • 0 comments

For example, we construct a page URL does not exist: https://www.amazon.com/dp/006323047_404.

PulsarR has to properly handle such pages:

  1. properly handle the status code
  2. do not retry

platonai avatar Mar 30 '23 03:03 platonai