JustAnotherArchivist
JustAnotherArchivist
Yes, I can reproduce it with those. Please file separate issues since they're different bugs than the `rest_id` one.
I'm unable to reproduce this crash anymore. I did get another `KeyError: 'rest_id'` crash, which is now fixed (564a5eca), but that's unrelated and comes from a tweet's card. If anyone...
@davira reported a user in #740 that seems to crash like this: IdiazAyuso. It's a TweetWithVisibilityResults object on tweet 1247569871782756354 (referencing 1247316200029380610). I'll treat that as the original issue here.
snscrape's behaviour matches [Twitter's web interface](https://twitter.com/search?q=%23chatgpt%20since%3A2022-11-01%20until%3A2022-11-30%20lang%3Afr&f=live). But also, ChatGPT was only released on 30 November; are you sure there were tweets with that hashtag before then? I'm not aware OpenAI...
There is no documentation of the individual fields yet. Besides the general lack of documentation, I haven't yet figured out how to properly document the fields (Python doesn't have attribute...
> I guess Pushshift changed that with their recent botched API migration. _Originally posted by @JustAnotherArchivist in https://github.com/JustAnotherArchivist/snscrape/issues/698#issuecomment-1416076639_
`itertools.islice` would be the most elegant approach. But yeah, this is best solved outside of snscrape since there are so many different ways how someone might want to filter results....
I looked into this a bit more, specifically how to do this without a big remodelling of the snscrape internals, i.e. still using dataclasses. No concrete plan yet, just dumping...
Analysis of the aforementioned generators: * GenSON doesn't even support `$ref`, so self-referential schemas (such as `Tweet.retweetedTweet` → `Tweet`) are impossible I think. * dataclasses-jsonschema and its forks are outdated;...
Caused by tweet 1602600450255163393. Its card has swipeable media, but the second one is simply missing from Twitter's response. The web interface shows a generic 'Something went wrong.' error. (I.e....