SerpScrap
SerpScrap copied to clipboard
Standard example example_simple.py returns only SERP Youtube results insertions
Output of standard exmaple file example_simple.py. Only Youtube insertions have been scrapped. Also I saw that Google pages css selectors have been changed.
{'query': 'bienen',rocessed.[0m 'query_num_results_page': 4, 'query_num_results_total': '0', 'query_page_number': 1, 'screenshot': '/tmp/screenshots/2020-10-15/google_bienen-p1.png', 'serp_domain': 'www1.wdr.de', 'serp_rank': 1, 'serp_rating': None, 'serp_sitelinks': None, 'serp_snippet': '14:24#bienenlive — Basiswissen BienenWDR - 2019-12-05', 'serp_title': '14:24#bienenlive — Basiswissen BienenWDR - 2019-12-05', 'serp_type': 'videos', 'serp_url': 'https://www1.wdr.de/mediathek/video/sendungen/planet-schule/video-bienenlive--basiswissen-bienen-100.html', 'serp_visible_link': None}
{'query': 'bienen', 'query_num_results_page': 4, 'query_num_results_total': '0', 'query_page_number': 1, 'screenshot': '/tmp/screenshots/2020-10-15/google_bienen-p1.png', 'serp_domain': 'www.youtube.com', 'serp_rank': 2, 'serp_rating': None, 'serp_sitelinks': None, 'serp_snippet': 'PeržiūraPeržiūra44:39Rettung für unsere Bienen? Ein Forscher ' 'macht Hoffnung für ...NDR DokuYouTube - 2019-04-15', 'serp_title': 'PeržiūraPeržiūra44:39Rettung für unsere Bienen? Ein Forscher ' 'macht Hoffnung für ...NDR DokuYouTube - 2019-04-15', 'serp_type': 'videos', 'serp_url': 'https://www.youtube.com/watch?v=1f0sjiGtWIQ', 'serp_visible_link': None}
{'query': 'bienen', 'query_num_results_page': 4, 'query_num_results_total': '0', 'query_page_number': 1, 'screenshot': '/tmp/screenshots/2020-10-15/google_bienen-p1.png', 'serp_domain': 'www.youtube.com', 'serp_rank': 3, 'serp_rating': None, 'serp_sitelinks': None, 'serp_snippet': 'PeržiūraPeržiūra9:27Die wunderbare Organisation der Bienen | ' 'BRBayerischer RundfunkYouTube - 2018-03-22', 'serp_title': 'PeržiūraPeržiūra9:27Die wunderbare Organisation der Bienen | ' 'BRBayerischer RundfunkYouTube - 2018-03-22', 'serp_type': 'videos', 'serp_url': 'https://www.youtube.com/watch?v=DH0uywA5CrU', 'serp_visible_link': None}
{'query': 'bienen', 'query_num_results_page': 4, 'query_num_results_total': '0', 'query_page_number': 1, 'screenshot': '/tmp/screenshots/2020-10-15/google_bienen-p1.png', 'serp_domain': 'www.youtube.com', 'serp_rank': 4, 'serp_rating': None, 'serp_sitelinks': None, 'serp_snippet': 'PeržiūraPeržiūra4:48Bienen: Leben im Bienenstock - Biologie ' '| Duden LearnattackDuden LearnattackYouTube - 2019-04-07', 'serp_title': 'PeržiūraPeržiūra4:48Bienen: Leben im Bienenstock - Biologie | ' 'Duden LearnattackDuden LearnattackYouTube - 2019-04-07', 'serp_type': 'videos', 'serp_url': 'https://www.youtube.com/watch?v=eVcNIgnvXhE', 'serp_visible_link': None}