openai-cookbook
openai-cookbook copied to clipboard
Catch the exception and continue processing the next link
As of the now, the web crawler stops processing the remaining items from the link queue if any of the link is invalid. To fix the issue a new exception handling code was added to catch the exception and procced with the next item in the link queue.