snscrape

snscrape copied to clipboard

Disappearing tweets

1

### Describe the bug When I try to scrape tweets published over a given period of time in a csv file, the csv sometimes comes back completely empty. ### How...

jnelson92

Search excluding retweets, replies, and quote tweets from Twitter search results?

2

I would like to search for recent tweets, by keyword, but only retrieve original tweets, not retweets, replies, or quote tweets. In the API, I can do this by including...

ViennaMike

Error "module 'snscrape.modules.telegram' has no attribute 'TelegramScraper'"

1

Hi, I have repeatedly received the above error. Using Python 3.11 and snscrape version 0.5.0.20230113 on mac BigSur 11.6. Any help is appreciated!

janmatti

scraped telegram posts having line breaks like the original post

1

When I tested snscrape for Telegram channels, I recognized that the posts don't have line breaks. And this caused problem for my text analysis. So I created the static method...

mohammadali-seifkashani

Twitter: raise ValueError('missing media')

1

### Describe the bug Hello, I used the sntwitter module and I get a ValueError ('missing media') when trying to use it in certain range of dates. my code: ```python3...

Ahmed-Sh

Thread safety

4

Since people seem to keep trying to use snscrape with threads (despite this not being listed as a feature anywhere) and running into problems (seemingly without searching the issues)... **snscrape...

JustAnotherArchivist

Reddit comment parentID has the wrong format

1

> The id and parentID seem to have different entry format, like say this "id": "t1_j72b5yy", "parentId": 41785179015. I can see how I can deduce what all comments come from...

JustAnotherArchivist

Add a JSON Schema

2

The JSON currently produced by snscrape has some issues: deprecated fields[^0] can't be marked as such (compatibility), and default values are included (bloat). This can't be fixed within JSON, but...

JustAnotherArchivist

Fetch most relevant tweets for a specified time period

1

### Describe the feature As decribed in the following post ( https://twittercommunity.com/t/introducing-the-sort-order-parameter-for-search-endpoints-in-the-twitter-api-v2/166377 ) the '/recent' API endpoint allows to fetch for example the 100 most relevant tweets for a given...

arthurGrigo

twitter: Fix to KeyError & TweetTombstone

6

Hi. This PR contains a solution so that collecting tweets from the profile does not stop at these errors: 1) https://github.com/JustAnotherArchivist/snscrape/issues/603 2) fix for various KeyError errors 3) logger typo...

vladkens