twitter_scraping
twitter_scraping copied to clipboard
Scraping "restricted" accounts
Accounts like https://twitter.com/jackiec57 are unscrapible in search,
unless the user has logged into the browser, and turned off sensitivity.
Scrapy can't scrape it as it does not allow cookies, can Selenium?
Some ideas to reduce the repetitive need to click "show" on restricted accounts:
- Login https://gist.github.com/momota10/969d904b4cad239da2a5c00df1ad87e7
- Go to https://twitter.com/settings/safety
- Check "show sensitive content" in
<input name="search-settings-nsfw" checked="" class="SearchSettings-toggleInput SearchSettings-toggleInput--sensitive" type="checkbox">
- Click "submit"
<button id="settings_save" class="EdgeButton EdgeButton--primary EdgeButton--medium" type="submit" disabled="">Save changes</button>