amazon-product-review-scraper icon indicating copy to clipboard operation
amazon-product-review-scraper copied to clipboard

AttributeError: 'NoneType' object has no attribute 'tbody'`

Open julianchow513 opened this issue 1 year ago • 1 comments

from amazon_product_review_scraper import amazon_product_review_scraper
review_scraper = amazon_product_review_scraper(amazon_site="amazon.ca", product_asin="B09NPS8ZXC")
IDE and Envs\Anaconda3\lib\site-packages\amazon_product_review_scraper\amazon_product_review_scraper.py in __init__(self, amazon_site, product_asin, sleep_time, start_page, end_page)
     27         self.reviews_dict = {"date_info":[], "name":[], "title":[], "content":[], "rating":[]}
     28 
---> 29         self.proxies = self.proxy_generator()
     30         self.max_try = 10
     31         self.ua = ua.random

IDE and Envs\Anaconda3\lib\site-packages\amazon_product_review_scraper\amazon_product_review_scraper.py in proxy_generator(self)
    168         soup = BeautifulSoup(response.content, 'html.parser')
    169         proxies_table = soup.find(id='proxylisttable')
--> 170         for row in proxies_table.tbody.find_all('tr'):
    171             proxies.append({
    172                 'ip':   row.find_all('td')[0].string,

AttributeError: 'NoneType' object has no attribute 'tbody'

julianchow513 avatar May 29 '23 02:05 julianchow513

same error

usmanyaqoob49 avatar Feb 14 '24 09:02 usmanyaqoob49

same error

You need to override the proxy generator and it will work just fine.

YasserMickey avatar Nov 04 '24 20:11 YasserMickey