crawler-python icon indicating copy to clipboard operation
crawler-python copied to clipboard

Published 20 hours ago • verified publisher icon hezila

the yelp crawler is too slow

Open hezila opened this issue 11 years ago • 1 comments

need optimize the review crawling parts (i.e., reviews_in_page function).

hezila avatar Jan 15 '14 15:01 hezila

Options

  1. use the lxml instead of beautifulsoup to extract the information we wanted?

hezila avatar Jan 16 '14 05:01 hezila