scrapeVIN icon indicating copy to clipboard operation
scrapeVIN copied to clipboard

Unable to scrape item

Open Freccia opened this issue 1 year ago • 9 comments

Hello,

I followed the README and got this error while running the code :

➜  scrapeVIN git:(master) ✗ python3 Codes/Scraper_final.py
Results are saved under current directory :  /Users/user/Documents/code/scrapeVIN \Scraped
&order=newest_first
We start to scrape page n° 1
You might need to manually accept the cookies (only necessary at page 1).
 Press Enter to continue when it is done (or not displayed on the site)...
Thanks!
1
Unable to scrape item n°1
2
Unable to scrape item n°2
3
Unable to scrape item n°3
4
Unable to scrape item n°4
5
Unable to scrape item n°5
6
Unable to scrape item n°6
7
Unable to scrape item n°7
8
Unable to scrape item n°8
9
Unable to scrape item n°9
10
Unable to scrape item n°10
/Users/user/Documents/code/scrapeVIN/Codes/functions_FR_BEL_LUX_NL_SPAIN.py:167: FutureWarning: The frame.append method is deprecated and will be removed from pandas in a future version. Use pandas.concat instead.
  DATA_ALL = DATA_ALL.append(scrape_research_page(search_url))
We finished to scrape page n° 1
We start to scrape page n° 2
1
Unable to scrape item n°1
2
Unable to scrape item n°2
3
Unable to scrape item n°3
4
Unable to scrape item n°4
5
Unable to scrape item n°5
6
Unable to scrape item n°6
7
Unable to scrape item n°7
8
Unable to scrape item n°8
9
Unable to scrape item n°9
10
Unable to scrape item n°10
/Users/user/Documents/code/scrapeVIN/Codes/functions_FR_BEL_LUX_NL_SPAIN.py:173: FutureWarning: The frame.append method is deprecated and will be removed from pandas in a future version. Use pandas.concat instead.
  DATA_ALL = DATA_ALL.append(scrape_research_page(search_url))
We finished to scrape page n° 2
We finished scraping the query etro between page 1 and page 2!
Results are saved under current directory :  /Users/user/Documents/code/scrapeVIN \Scraped

any idea why ?

I can provide more info if needed. Thank you.

Freccia avatar Oct 16 '22 10:10 Freccia

@Freccia Same here, did you resolve it ?

judzk avatar Oct 23 '22 11:10 judzk

@judzk not yet, might work on it tomorrow

Freccia avatar Oct 23 '22 12:10 Freccia