openai-cookbook icon indicating copy to clipboard operation
openai-cookbook copied to clipboard

Catch the exception and continue processing the next link

Open ashokmanghat opened this issue 2 years ago • 0 comments

As of the now, the web crawler stops processing the remaining items from the link queue if any of the link is invalid. To fix the issue a new exception handling code was added to catch the exception and procced with the next item in the link queue.

ashokmanghat avatar Feb 23 '23 08:02 ashokmanghat