TheTechRobo

Repeats the "this pr is too big" message

15

whenever i push it repeats it. really annoying as i keep getting notifications for nothing.

When trying to load a CDX (local or remote), despite [this doc](https://replayweb.page/docs/formats) saying it's supported, it shows a "Please match the requested format" and refuses to load the CDX.

Hey, I don't know if it's possible, but I have a rather large WARC (1.3 Gigabytes for a crawl of a probably 1mb site), and I want to see where...

Add Parler user scraper

2

My code quality leaves a lot to be desired don't judge Fixes #155

Truth Social

7

When Truth Social is finally released to the public (if it's available to the unauthenticated) and I'm finished the parler scraper I'll probably add it to snscrape. It seems like...

Weibo: "User does not exist" when using --name on certain accounts

10

Haven't tested with user IDs. ``` ~/u/steam ❯❯❯ python3 parse_weibo.deduped >> weibo.jsonl ['snscrape', '--jsonl', '--progress', 'weibo-user', '--name', 'fangshengmeng'] 2022-04-03 22:27:12.723 WARNING snscrape.modules.weibo User does not exist Finished, 0 results ['snscrape',...

Crash on `TweetUnavailable` results

3

snscrape twitter-tweet --recurse 1500507885922619394 ``` Traceback (most recent call last): File "/home/thetechrobo/.local/bin/snscrape", line 8, in sys.exit(main()) File "/home/thetechrobo/.local/lib/python3.9/site-packages/snscrape/_cli.py", line 308, in main for i, item in enumerate(scraper.get_items(), start = 1):...

Google Groups?

1

Is Google Groups within the scope of snscrape? I couldn't find a single scraping tool that works since Google did the redesign and removed the RSS feeds.

Add issue templates for snscrape

5

Test at https://github.com/TheTechRobo/snscrape/issues/new/choose

any way to pass context as parameters?

1

I'm using Rocket and one issue I've noticed with Tera is that I need to make a BTreeMap or HashMap or similar to pass variables. This is a problem because...