Webklex
[Question] Is it expected to take more then 24h to download bookmarks?
First of all, I'm very happy that this tool exists and with how reliable it's working.
It's currently running on my machine since more than 24 hours, and still working. It has downloaded 1539 bookmarks so far, reaching back to May 2020. I'm using the default delay of 30s.
Most of the time, it outputs a line like this about 45 times:
[warning] twitter: api error at cursor "xXxXxXxXr73YLZ1gsAAA==" with BadRequest: User does not have permission to view this custom timeline: 96895963281XXXXXX (same numbers and IDs in all 45 lines, redacted some digits pro privacy reasons)
Then about 25 lines like this:
[success] New tweet fetched: 132252835XXXXXXXX posted on Sat Oct 31 13:18:26 +0000 2020 (different tweet ID in each line)
and so on.
Is this common, known behavior? Or is it just me? FYI, I',m using this on a 1 MBit/s internet connection, current MacBook Pro, and access to other Twitter APIs is as fast as one would assume (e.g. 100 Tweets per second using statuses/lookup).
Any idea what's slowing this down, or what could be done to speed it up? It it's normal to take so long, maybe there should be a warning in the README so that users do not expect it to finish in a few minutes? Also, I Imagine that most users might give up when there are just error messages for more than 20 minutes, not knowing that the program will continue to download if they just wait.
I had the same issues; I decided then to go the "danger" way and set in my config file the option to delete the downloaded bookmarks and started again.
I saved every single "data/" directory into distinct dicrectories outside the tbm directory like "data1/", "data2/" etc.
In a second and a third run, bookmarks which were actually deleted are more the less notified with many many lines like "Empty tweet...". After one hour of seeing this and having no bookmarks shown in Twitter, I decided to stop the tbm.
I merged successfully all downloaded data1, 2, 3 subdirectories for offline viewing my bookmarks and was happy with the result.
I hope this helps.
Small update: after 5 days of run time, my computer had a short internet outage, and after that, only printed the following line over and over for hours (same line as mentioned above):
[warning] twitter: api error at cursor "xXxXxXxXr73YLZ1gsAAA==" with BadRequest: User does not have permission to view this custom timeline: 96895963281XXXXXX
I noticed that it had saved a bookmark from Wed Feb 28 15:05:48 +0000 2018 shortly before the outage, which is exactly the day that twitter rolled out the bookmark feature. So I conclude that tbm is actually finished now.