tiktok-scraper
tiktok-scraper copied to clipboard
drawrowfly
Error logging?
Is your feature request related to a problem? Please describe.
For some profiles, I'm getting "Error while scraping:
Describe the solution you'd like Is there a way to show error messages for issue with each profile?
Yeah, if all the video's are not downloaded. And also if i could add further, a Error Message if the profile is not found. eg. if i type afd8hend, which doesn't exist, as a username, it could show profile not found.
I would like to second this - Currently, if a profile is not found, it only shows as 0 videos downloaded. It would be more sensible to show and Error (and continue execution if bulk scraping) instead of showing 0 videos downloaded.
Out of curiosity, did errors ever get added? Every time I run tiktokscraper it seems to complete successfully but scrapes 0 posts. It doesn't report any errors though so I have no idea what could be wrong. Note: I have gotten it to work on another machine so I know the args I'm passing work. I just don't know what's wrong with my setup on my other machine.
Out of curiosity, did errors ever get added? Every time I run tiktokscraper it seems to complete successfully but scrapes 0 posts. It doesn't report any errors though so I have no idea what could be wrong. Note: I have gotten it to work on another machine so I know the args I'm passing work. I just don't know what's wrong with my setup on my other machine.
I frequently have this problem as well. I'll run it and it will scrape a bunch of posts. Then the next day or so I try it on other valid users and it completes while scraping 0 posts. Same result in bulk mode and in single-user mode. I think a likely reason is that our IP was blocked after scraping too much. I wonder if there's a way the API can tell this is the case and print an error instead.
I still have this issue and haven't figured out how to fix it. I also haven't figured out if there's any logs reported anywhere.
On Wed, Jun 9, 2021 at 7:19 AM Alex Pastel @.***> wrote:
Out of curiosity, did errors ever get added? Every time I run tiktokscraper it seems to complete successfully but scrapes 0 posts. It doesn't report any errors though so I have no idea what could be wrong. Note: I have gotten it to work on another machine so I know the args I'm passing work. I just don't know what's wrong with my setup on my other machine.
I frequently have this problem as well. I'll run it and it will scrape a bunch of posts. Then the next day or so I try it on other valid users and it completes while scraping 0 posts. Same result in bulk mode and in single-user mode. Looking to see if there's another issue on this...
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/drawrowfly/tiktok-scraper/issues/120#issuecomment-857734988, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALQNIRXDDXKRXXIBFXSGKJDTR5Z6ZANCNFSM4MVMNK3Q .
-- Thanks, John
You have to look into using a proxy because your IP was likely blocked. tiktok-scraper supports this and mentions how to supply your proxy as an argument. As far as setting up a proxy, that's something you have to do on your own.
I have tried using a VPN to mask my IP to various locations and it still has issues though. Shouldn't that be functionally equivalent? Also, is there an error log or message anywhere that I can determine why something failed?
On Thu, Jun 10, 2021 at 9:32 AM Alex Pastel @.***> wrote:
You have to look into using a proxy because your IP was likely blocked. tiktok-scraper supports this and mentions how to supply your proxy as an argument. As far as setting up a proxy, that's something you have to do on your own.
— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/drawrowfly/tiktok-scraper/issues/120#issuecomment-858770057, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALQNIRSOL3CQ4LYGA4XH5YTTSDSKHANCNFSM4MVMNK3Q .
-- Thanks, John