ntscraper icon indicating copy to clipboard operation
ntscraper copied to clipboard

Error fetching more than 100 tweets

Open molina180 opened this issue 1 year ago • 2 comments

If you can scrape more than 100 tweets, it only fetches 53 or 55. I think there's an issue with some instances.

Testing instances: 100%|███████████████████████████████████████████████████████████████████████| 30/30 [01:11<00:00, 2.38s/it] 09-Jan-24 18:13:59 - No instance specified, using random instance https://nitter.perennialte.ch 09-Jan-24 18:14:07 - Current stats for RTXSUPER: 6 tweets, 0 threads... 09-Jan-24 18:14:12 - Current stats for RTXSUPER: 8 tweets, 0 threads... 09-Jan-24 18:14:16 - Current stats for RTXSUPER: 12 tweets, 0 threads... 09-Jan-24 18:14:21 - Current stats for RTXSUPER: 16 tweets, 0 threads... 09-Jan-24 18:14:26 - Current stats for RTXSUPER: 24 tweets, 0 threads... 09-Jan-24 18:14:30 - Current stats for RTXSUPER: 30 tweets, 0 threads... 09-Jan-24 18:14:34 - Current stats for RTXSUPER: 36 tweets, 0 threads... 09-Jan-24 18:14:39 - Current stats for RTXSUPER: 38 tweets, 0 threads... 09-Jan-24 18:14:44 - Current stats for RTXSUPER: 43 tweets, 0 threads... 09-Jan-24 18:14:49 - Current stats for RTXSUPER: 48 tweets, 0 threads... 09-Jan-24 18:14:53 - Current stats for RTXSUPER: 49 tweets, 0 threads... 09-Jan-24 18:14:58 - Current stats for RTXSUPER: 50 tweets, 0 threads... 09-Jan-24 18:15:02 - Current stats for RTXSUPER: 51 tweets, 0 threads... 09-Jan-24 18:15:07 - Current stats for RTXSUPER: 51 tweets, 0 threads... 09-Jan-24 18:15:11 - Current stats for RTXSUPER: 52 tweets, 0 threads... 09-Jan-24 18:15:16 - Current stats for RTXSUPER: 52 tweets, 0 threads... 09-Jan-24 18:15:20 - Current stats for RTXSUPER: 52 tweets, 0 threads... 09-Jan-24 18:15:24 - Current stats for RTXSUPER: 52 tweets, 0 threads... 09-Jan-24 18:15:28 - Current stats for RTXSUPER: 52 tweets, 0 threads... 09-Jan-24 18:15:32 - Current stats for RTXSUPER: 53 tweets, 0 threads... 09-Jan-24 18:15:36 - Current stats for RTXSUPER: 54 tweets, 0 threads... 09-Jan-24 18:15:41 - Current stats for RTXSUPER: 54 tweets, 0 threads... 09-Jan-24 18:15:45 - Current stats for RTXSUPER: 54 tweets, 0 threads... 09-Jan-24 18:15:48 - Empty page on https://nitter.perennialte.ch

molina180 avatar Jan 10 '24 00:01 molina180

Tru with another instance, but if there are not more tweets for this term, in the selected date and in the selected instance, you don't gonna get more.

AritzUMA avatar Jan 16 '24 13:01 AritzUMA

I have the same problem and get Empty page on... exactly after 55 tweets, Did you find a solution for this?

GinaMhd avatar Jul 05 '24 15:07 GinaMhd